-- Logs begin at Tue 2022-07-12 12:33:33 UTC, end at Tue 2022-07-12 13:33:45 UTC. -- Jul 12 13:06:09.822904 dv-cinder-797608-55-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 13:06:09.832361 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 13:06:09 2022] *** Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: nodename: dv-cinder-797608-55-iscsi Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: machine: x86_64 Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: clock source: unix Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: pcre jit disabled Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: detected number of CPU cores: 4 Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: current working directory: / Jul 12 13:06:09.834337 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: detected binary path: /usr/bin/uwsgi-core Jul 12 13:06:09.834943 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: your processes number limit is 47680 Jul 12 13:06:09.834943 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: your memory page size is 4096 bytes Jul 12 13:06:09.834943 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: detected max file descriptor number: 2048 Jul 12 13:06:09.834943 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: lock engine: pthread robust mutexes Jul 12 13:06:09.834943 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: thunder lock: enabled Jul 12 13:06:09.834943 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 13:06:09.834943 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 13:06:09.877853 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: Python main interpreter initialized at 0x55d8f4a639c0 Jul 12 13:06:09.877853 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: python threads support enabled Jul 12 13:06:09.877853 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: your server socket listen backlog is limited to 100 connections Jul 12 13:06:09.877853 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: your mercy for graceful operations on workers is 90 seconds Jul 12 13:06:09.878222 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 13:06:09.878222 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: *** Operational MODE: preforking *** Jul 12 13:06:09.878490 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: *** uWSGI is running in multiple interpreter mode *** Jul 12 13:06:09.878490 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: spawned uWSGI master process (pid: 103441) Jul 12 13:06:09.878690 dv-cinder-797608-55-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 13:06:09.880131 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: spawned uWSGI worker 1 (pid: 103442, cores: 1) Jul 12 13:06:09.880131 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: spawned uWSGI worker 2 (pid: 103443, cores: 1) Jul 12 13:06:09.880131 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 13:06:10.532710 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:06:10.554875 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:06:11.630722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:06:11.630722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: from cryptography.utils import int_from_bytes Jul 12 13:06:11.631349 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:06:11.631349 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: from cryptography.utils import int_from_bytes Jul 12 13:06:11.660423 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:06:11.660423 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: from cryptography.utils import int_from_bytes Jul 12 13:06:11.660967 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:06:11.660967 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: from cryptography.utils import int_from_bytes Jul 12 13:06:14.054036 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:06:14.054651 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:06:14.054745 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:06:14.055158 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:06:14.055407 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:06:14.055788 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.056102 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.056415 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.056727 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.057047 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.057346 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.057657 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.057968 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.058285 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.058521 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.058828 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.058933 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:06:14.059333 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-55-iscsi {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.059417 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:06:14.059494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.060022 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:06:14.060171 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.060361 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.060457 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:06:14.060624 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:06:14.060758 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.060928 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.061015 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.061251 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.061357 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.061548 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.061639 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.061917 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.062010 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.062242 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.063254 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.063402 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.063509 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.063594 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.063715 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.063796 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.063872 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064007 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064101 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064186 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064269 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064362 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064447 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064535 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-55-iscsi {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064621 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064699 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.064965 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.065149 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.065276 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.065736 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-55-iscsi {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.065846 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.066118 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.066221 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.066440 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.066529 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.066766 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.066856 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.067221 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.067564 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.067775 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.067890 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.068095 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.068184 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.068401 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.068574 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.068713 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.068809 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.069046 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.069145 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.069359 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.069449 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.069663 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.069751 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.069973 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.070085 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.070279 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.070381 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.070571 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.070660 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.070871 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.071028 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.071184 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.071272 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-55-iscsi {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.071496 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.071583 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.071795 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.071888 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.072094 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.072180 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.072341 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.072556 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.072651 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.072865 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.072950 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.073172 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.073260 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.073491 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.073578 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.073783 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.073869 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.074029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.074117 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.074340 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.074425 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.074653 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.074752 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.074970 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.075060 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.075272 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.075369 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.075572 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.075666 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.075870 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.075963 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.076168 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.076262 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.076468 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.076562 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.076765 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.076856 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.077062 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.077156 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.077311 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.077396 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.077621 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.077721 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.077941 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.078027 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.078254 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.078387 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.078567 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.078654 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.078814 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.078999 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.079107 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.079221 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.079383 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.079518 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.079698 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.079849 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.080005 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.080161 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.080306 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.080505 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.080825 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.081161 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.081265 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.081431 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.081517 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.081730 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.081822 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.082028 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.082116 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.082340 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.082427 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.082664 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.082757 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.082973 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.083063 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.083221 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.083345 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.083516 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.083672 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.083809 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.083981 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.084119 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.084301 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.084415 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.084697 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.084787 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.084946 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.085039 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.085249 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.085335 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.085558 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.085651 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.085851 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.085945 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.086149 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.086236 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.086446 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.086534 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.086741 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.086828 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.087067 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.087173 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.087367 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.087460 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.087662 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.087748 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.087954 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.088048 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.088267 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.088353 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.088579 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.088666 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.088823 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.088924 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.089126 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.089263 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.089425 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.089514 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.089727 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.089829 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.090028 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.090116 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.090323 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.090432 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.090621 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.090734 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.090912 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.091023 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.091241 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.091389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.091519 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.091665 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.091828 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.091957 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.092125 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.092269 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.092409 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.092542 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.092712 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.092843 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.093000 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.093132 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.093339 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.093471 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.093601 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.093732 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.093870 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.093999 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.094158 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.094294 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.094435 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.094578 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.094714 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.094845 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.095034 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.095167 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.095330 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.095471 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.095623 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.095768 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.095915 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.096046 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.096294 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.096600 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.096755 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.096914 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.097097 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.097214 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.097407 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.097514 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.097715 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.097810 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.098040 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.098128 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.098349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.098447 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.098655 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.098751 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.098990 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.099095 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.099294 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.099381 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.099598 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.099695 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.099912 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.100011 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.100215 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.100302 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.100514 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.100611 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.100815 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.100909 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.101112 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.101199 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.101413 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.101511 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.101710 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.101807 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.102008 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.102094 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.102307 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.102404 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.102603 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.102704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.102914 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.103027 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.103256 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.103344 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.103559 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.103644 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.103862 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.103947 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.104163 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.104256 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.104471 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.104557 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:06:14.104789 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.104885 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.105100 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.105186 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.105403 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.105488 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.105733 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.105827 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.106059 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.106161 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.106362 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.106449 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.106679 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.106774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.107004 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.107094 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.107308 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.107405 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.107609 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.107705 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.107911 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.107997 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.108222 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.108307 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.108527 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.108622 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.108831 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.108916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.109136 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.109223 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.109440 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.109540 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.109742 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.109828 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.110041 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.110129 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.110343 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.110429 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.110642 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.110729 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.110973 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.111068 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.111279 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.111372 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.111587 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.111684 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.111933 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.112239 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.112498 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.112593 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.112760 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.112855 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.113106 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.113192 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.113411 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.113505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.113711 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.113805 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.114007 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.114109 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.114306 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.114406 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.114601 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.114694 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.114912 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.115109 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.115255 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.115341 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.115550 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.115636 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.115874 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.115967 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.116172 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.116257 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.116473 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.116560 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.116773 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.116868 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.117074 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.117160 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.117371 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.117459 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.117673 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.117761 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.117973 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.118075 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.118268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.118359 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.118582 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.118669 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.118880 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.119000 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.119202 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.119303 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.119509 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.119596 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.119803 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.119895 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.120098 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.120184 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.120396 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.120483 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.120696 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.120780 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.120995 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.121079 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.121294 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.121381 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.121640 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.121737 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.121901 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.122002 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.122205 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.122292 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.122506 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.122591 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.122832 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.122927 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.123160 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.123249 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.123468 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.123555 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.123772 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.123867 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.124084 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.124210 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.124385 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.124494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.124680 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.124784 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.124980 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.125082 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.125276 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.125370 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.125573 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.125667 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.125872 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.125966 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.126169 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.126275 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.126463 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.126558 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.126755 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.126850 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.127072 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.127167 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.127457 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.127552 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.127761 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.128074 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.128214 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.128373 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.128531 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.128668 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.128843 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.128960 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.129154 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.129249 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.129483 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.129584 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.129799 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.129892 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.130110 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.130205 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.130446 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.130531 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.130776 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.130860 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.131108 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.131242 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.131431 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.131548 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.131757 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.131854 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.132073 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.132169 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.132377 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.132463 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.132734 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.132830 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.132986 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.133073 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.133286 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.133372 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.133586 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.133679 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.133891 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.133987 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.134190 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.134276 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.134487 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.134579 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.134785 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.134871 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.135110 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.135200 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.135406 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.135500 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.135712 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.135798 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.136013 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.136097 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.136315 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.136410 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.136615 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.136700 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.136917 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.137009 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.137229 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.137322 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.137534 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.137629 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.137835 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.137921 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.138136 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.138230 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.138435 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.138528 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.138736 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.138822 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.139065 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.139167 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.139370 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.139464 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.139679 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.139774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.139980 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.140074 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.140289 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.140380 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.140587 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.140671 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.140895 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.140982 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.141193 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.141290 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.141494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.141581 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.141848 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.141965 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.142115 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.142270 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.142407 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.142546 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.142687 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.142832 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.143066 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.143201 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.143446 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.143753 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.143959 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.144093 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.144256 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.144386 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.144591 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.144731 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.144908 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.145043 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.145213 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.145354 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.145515 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.145658 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.145805 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.145938 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.146104 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.146242 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.146411 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.146552 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.146712 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.146853 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.147032 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.147167 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.147327 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.147468 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.147629 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.147772 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.147940 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.148072 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.148244 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.148395 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.148558 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.148695 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.148860 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.148993 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.149163 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.149300 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.149463 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.149595 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.149769 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.149911 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.150053 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.150185 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.150353 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.150487 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.150647 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.150788 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.150934 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.151049 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.151289 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.151376 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.151590 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.151689 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.151961 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.152071 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.152199 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.152351 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.152498 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.152594 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.152799 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.152886 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.153101 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.153195 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.153402 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.153503 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.153704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.153791 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.154007 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.154096 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.154309 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.154405 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.154606 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.154704 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.154907 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.155015 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.155230 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.155317 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.155531 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.155617 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.155830 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.155915 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.156145 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.156233 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.156448 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.156535 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.156752 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.156838 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.157054 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.157151 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.157353 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.157439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.157651 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.157736 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.157957 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.158050 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.158264 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.158519 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.158663 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.158943 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.159276 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.159430 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.159592 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.159740 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.159906 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.160086 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.160217 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.160398 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.160543 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.160703 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.160865 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.161020 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.161201 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.161344 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.161501 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.161651 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.161805 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.161961 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.162177 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.162269 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.162389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.162561 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.162696 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.162889 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.163021 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.163227 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.163315 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.163532 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.163619 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.163838 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.163938 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.164144 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.164230 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.164447 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.164531 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.164742 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.164839 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.165039 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.165126 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.165345 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.165432 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.165643 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.165731 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.165946 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.166030 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.166242 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.166328 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.166549 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.166634 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.166847 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.166932 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.167168 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.167428 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.167525 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.167748 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.167835 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.168056 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.168150 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.168367 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.168454 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.168680 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.168765 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.168995 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.169089 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.169322 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.169410 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.169619 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.169704 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.169918 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.170049 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.170217 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.170313 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.170521 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.170608 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.170818 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.170912 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.171138 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.171236 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.171440 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.171527 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.171740 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.171825 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.172034 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.172128 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.172338 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.172442 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.172638 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.172724 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.172936 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.173023 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.173235 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.173320 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.173530 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.173615 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.173830 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.173917 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.174125 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.174212 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.174526 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.174612 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.174837 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.175167 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.175281 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.175464 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.175590 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.175766 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.175919 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.176066 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.176229 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.176363 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.176535 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.176665 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.176837 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.176960 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.177142 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.177269 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.177482 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.177587 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.177784 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.177872 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.178124 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.178224 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.178423 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.178523 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.178724 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.178810 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.179042 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.179130 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.179360 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.179460 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.179663 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.179750 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.179957 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.180043 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.180257 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.180353 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.180556 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.180642 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.180852 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.180938 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.181146 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.181235 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.181443 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.181528 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.181751 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.181838 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.182055 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.182143 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.182358 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.182485 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.182662 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.182751 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.182970 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.183062 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.183280 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.183364 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.183577 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.183676 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.183872 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.183957 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.184169 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.184256 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.184465 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.184560 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.185072 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.185178 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.185372 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.185458 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.185666 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.185768 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.185965 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.186058 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.186265 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.186351 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.186560 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.186659 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.186853 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.186969 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.187173 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.187261 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.187471 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.187566 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.187772 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.187860 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.188077 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.188164 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.188379 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.188495 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.188679 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.188768 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.188998 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.189083 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.189301 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.189389 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.189598 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.189682 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.189943 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.190104 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.190293 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.190567 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.190737 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.190869 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.191229 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.191333 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.191404 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.191477 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.191667 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.191763 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.191991 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.192091 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.192307 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.192459 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.192615 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.192706 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.192921 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.193023 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.193221 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.193307 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.193521 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.193607 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.193823 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.193918 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.194121 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.194219 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.194419 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.194504 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.194712 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.194806 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.195032 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.195122 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.195335 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.195430 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.195636 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.195725 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.195939 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.196026 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.196240 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.196328 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.196545 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.196634 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.196846 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.196932 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.197141 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.197233 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.197440 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.197526 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.197737 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.197832 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.198033 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.198128 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.198347 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.198445 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.198647 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.198735 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.198942 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.199105 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.199261 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.199357 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.199556 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.199642 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.199859 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.199953 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.200154 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.200249 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.200480 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.200568 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.200788 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.200883 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.201096 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.201183 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.201396 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.201482 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.201692 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.201787 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.202008 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.202094 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.202318 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.202404 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.202620 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.202713 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.202914 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.203035 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.203266 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.203352 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.203588 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.203684 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.203888 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.203982 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.204192 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.204279 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.204487 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.204574 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.204783 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.204876 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.205085 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.205171 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.205388 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.205482 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.205789 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.205873 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.206102 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.206404 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.206564 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.206722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.209416 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.209566 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.209692 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.209810 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.209916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210018 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210128 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210240 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210344 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210456 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210561 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210561 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210752 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210752 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.210942 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211086 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211194 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211297 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211399 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211399 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211602 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211705 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211774 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211839 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.211911 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212004 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212095 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212095 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212240 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212318 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212403 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212482 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212614 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212702 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212770 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212836 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212913 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.212991 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.213078 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.213157 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.213236 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.213320 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.213399 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.213490 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.213574 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.213740 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.213926 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.214145 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.214238 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.214463 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.214558 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.214763 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.214858 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.215101 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.215192 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.215420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.215513 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.215717 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.215830 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.216014 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.216110 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.216317 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.216412 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.216611 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.216699 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.216908 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.217003 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.217225 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.217318 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.217524 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.217632 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.217828 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.217914 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.218129 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.218231 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.218429 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.218536 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.218724 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.218811 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.219042 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.219242 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.219363 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.219552 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.219647 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.219862 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.219949 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.220182 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.220278 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.220503 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.220590 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.220826 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.220913 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.221173 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.221261 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.221509 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.221812 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.221982 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.222117 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.222306 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.222416 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.222645 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.222776 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.223373 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.223524 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.223634 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.223738 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.223841 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.223943 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.224045 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.224161 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.224268 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.224381 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.224537 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.224650 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.224849 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.224978 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.225168 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.225288 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.225521 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.225643 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.225758 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.225890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.226077 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.226191 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.226376 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.226489 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.226672 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.226795 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.226989 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.227129 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.227292 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.227431 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.227681 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.227796 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.227893 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.228065 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.228208 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.228336 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.228440 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.228689 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.228834 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.228995 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.229142 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.229305 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.229449 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.229607 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.229740 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.229881 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.229984 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.230180 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.230266 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.230475 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.230560 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.230769 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.230867 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.231096 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.231186 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.231415 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.231515 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.231720 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.231815 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.232021 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.232106 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.232343 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.232430 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.232743 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.232838 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.232965 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.233168 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.233305 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.233446 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.233590 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.233720 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.233857 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.233990 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.234135 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.234276 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.234447 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.234584 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.234747 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.234879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.235078 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.235165 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.235372 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.235463 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.235683 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.235782 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.235983 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.236081 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.236292 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.236380 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.236600 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.236688 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.236962 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.237444 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.237535 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.237779 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.237867 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.238085 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.238171 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.238393 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.238481 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.238695 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.238791 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.239020 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.239113 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.239328 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.239417 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.239628 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.239715 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.239932 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.240027 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.240231 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.240317 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.240532 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.240618 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.240836 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.240936 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.241139 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.241234 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.241458 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.241546 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.241761 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.241861 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.242082 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.242176 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.242388 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.242474 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.242690 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.242786 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.243015 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.243127 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.243318 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.243413 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.243655 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.243758 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.243954 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.244056 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.244256 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.244359 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.244563 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.244658 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.244868 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.244963 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.245170 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.245274 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.245471 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.245573 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.245773 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.245867 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.246076 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.246184 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.246378 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.246481 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.246678 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.246772 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.246997 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.247107 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.247303 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.247397 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.247619 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.247714 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.247932 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.248034 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.248240 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.248342 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.248542 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.248635 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.248849 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.248951 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.249153 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.249248 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.249658 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.249753 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.249966 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.250072 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.250285 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.250383 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.250600 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.250688 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.250908 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.251027 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.251244 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.251330 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.251557 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.251658 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.251871 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.251957 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.252170 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.252255 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.252555 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.252731 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.252858 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.253247 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.253347 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.253546 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.253642 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.253860 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.253949 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.254161 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.254248 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.254456 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.254552 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.254767 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.254855 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.255093 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.255224 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.255493 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.255615 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.255812 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.255960 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.256168 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.256258 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.256481 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.256578 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.256785 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.256873 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.257096 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.257190 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.257411 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.257500 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.257722 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.257816 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.258029 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.258117 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.258337 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.258424 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.258643 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.258728 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.258945 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.259098 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.259277 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.259366 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.259573 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.259659 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.259875 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.259970 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.260174 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.260262 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.260471 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.260558 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.260770 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.260866 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.261067 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.261155 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.261387 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.261475 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.261688 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.261788 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.261994 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.262081 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.262290 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.262510 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.262603 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.262820 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.262916 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.263195 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.263348 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.263471 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.263572 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.263770 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.263865 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.264076 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.264163 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.264373 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.264468 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.264673 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.264760 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.264969 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.265055 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.265277 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.265372 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.265575 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.265662 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.265889 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.266023 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.266174 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.266273 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.266491 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.266584 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.266797 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.266884 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.267121 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.267211 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.267427 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.267512 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.267727 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.267811 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.268168 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.268626 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.268860 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.269064 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.269217 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.269412 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.269539 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.269728 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.269866 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.270196 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.270290 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.270518 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.270615 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.270827 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.270914 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.271176 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.271266 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.271486 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.271576 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.271791 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.271877 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.272094 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.272181 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.272393 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.272482 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.272702 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.272788 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.273003 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.273089 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.273307 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.273460 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.273605 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.273706 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.273906 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.274000 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.274204 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.274300 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.274501 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.274594 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.274798 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.274893 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.275136 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.275239 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.275435 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.275532 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.275735 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.275832 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.276033 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.276128 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.276330 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.276417 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.276627 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.276723 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.276925 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.277012 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.277229 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.277323 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.277541 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.277629 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.277843 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.277938 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.278149 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.278235 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.278482 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.278583 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.278750 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.278836 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.279069 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.279160 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.279374 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.279463 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.279676 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.279770 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.279983 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.280070 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.280303 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.280406 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.280606 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.280694 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.280900 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.280998 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.281205 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.281291 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.281527 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.281616 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.281838 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.281933 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.282143 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.282230 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.282486 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.282571 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.282794 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.282889 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.283135 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.283361 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.283487 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.283831 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.283948 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.284249 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.284500 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.284596 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.284837 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.284924 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.285171 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.285267 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.285487 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.285574 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.285788 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.285872 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.286105 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.286192 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.286384 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.286478 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.286683 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.286769 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.287014 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.287106 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.287315 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.287417 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.287611 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.287706 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.287907 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.287994 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.288205 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.288317 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.288501 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.288603 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.288794 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.288880 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.289088 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.289181 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.289385 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.289480 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.289683 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.289771 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.289975 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.290062 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.290269 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.290357 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.290563 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.290649 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.290857 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.291035 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.291241 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.291334 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.291535 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.291620 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.291833 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.291918 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.292134 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.292222 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.292427 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.292513 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.292717 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.292805 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.293008 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.293103 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.293301 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.293387 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.293626 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.293732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.293950 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.294036 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.294255 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.294341 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.294557 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.294651 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.294857 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.294989 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.295193 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.295303 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.295491 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.295620 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.295803 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.295939 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.296114 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.296246 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.296420 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.296565 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.296719 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.296884 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.297040 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.297190 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.297339 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.297516 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.297639 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.297823 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.297941 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.298149 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.298248 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.298484 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.298571 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.298812 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.298908 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.299159 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.299298 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.299613 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.299743 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.299918 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.300236 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.300330 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.300546 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.300640 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.300857 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.300944 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.301164 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.301264 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.301469 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.301555 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.301793 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.301881 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.302095 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.302188 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.302393 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.302479 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.302700 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.302784 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.303022 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.303116 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.303325 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.303412 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.303632 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.303763 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.303929 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.304018 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.304276 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.304370 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.304528 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.304616 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.304827 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.304914 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.305127 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.305223 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.305425 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.305520 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.305723 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.305809 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.306027 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.306122 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.306324 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.306466 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.306625 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.306720 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.306921 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.307063 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.307238 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.307335 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.307535 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.307622 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.307820 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:06:14.307905 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.308181 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.308493 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.308812 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.309119 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.309436 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.310055 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.310377 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.310694 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.311029 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.311338 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.311664 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.311968 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.312274 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.312584 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.312889 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.313194 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.313500 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.313824 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.314160 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.314441 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.314766 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.315625 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.315950 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.316265 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.316575 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.316904 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.317214 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.317521 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.317835 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.318142 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.318449 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.318760 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.319094 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.319425 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.319754 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.320062 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.320388 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.320714 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.321059 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.321368 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.321714 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.322041 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.322353 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.322667 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.323002 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:06:14.323249 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:06:14.369018 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO dbcounter [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Registered counter for database nova_api Jul 12 13:06:14.385611 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO dbcounter [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Registered counter for database nova_api Jul 12 13:06:14.482990 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_db.sqlalchemy.engines [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:06:14.489725 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writer thread running {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:06:14.502027 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:06:14.509354 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writer thread running {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:06:14.544092 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.context [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),819583d6-75cf-414a-9fda-c907d3b6b6d5(cell1) {{(pid=103443) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:06:14.548056 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:06:14.549899 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:06:14.550753 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:06:14.552824 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:06:14.554867 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO dbcounter [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Registered counter for database nova_cell0 Jul 12 13:06:14.558576 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO dbcounter [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Registered counter for database nova_cell1 Jul 12 13:06:14.566103 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.context [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),819583d6-75cf-414a-9fda-c907d3b6b6d5(cell1) {{(pid=103442) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:06:14.567161 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_db.sqlalchemy.engines [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:06:14.568365 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_db.sqlalchemy.engines [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:06:14.570150 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:06:14.571785 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:06:14.572590 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:06:14.574626 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writer thread running {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:06:14.574759 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG oslo_concurrency.lockutils [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:06:14.576199 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writer thread running {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:06:14.576695 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO dbcounter [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Registered counter for database nova_cell0 Jul 12 13:06:14.580680 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO dbcounter [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Registered counter for database nova_cell1 Jul 12 13:06:14.588678 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:06:14.591940 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:06:14.595216 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writer thread running {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:06:14.717301 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO dbcounter [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Registered counter for database nova_cell0 Jul 12 13:06:14.726818 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_db.sqlalchemy.engines [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:06:14.731699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writer thread running {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:06:14.734363 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writer thread running {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:06:14.745481 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO dbcounter [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Registered counter for database nova_cell0 Jul 12 13:06:14.755036 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG oslo_db.sqlalchemy.engines [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:06:14.759974 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writer thread running {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:06:15.061487 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: WARNING keystonemiddleware.auth_token [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:06:15.068764 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: WARNING keystonemiddleware.auth_token [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:06:15.077864 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: WARNING keystonemiddleware.auth_token [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:06:15.085850 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: WARNING keystonemiddleware.auth_token [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:06:15.402193 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: WARNING keystonemiddleware.auth_token [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:06:15.408168 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: WARNING keystonemiddleware.auth_token [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:06:15.413547 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8f4a639c0 pid: 103443 (default app) Jul 12 13:06:15.415634 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:06:15.416803 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jul 12 13:06:15.417505 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Tue Jul 12 13:06:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:06:15.433862 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: WARNING keystonemiddleware.auth_token [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:06:15.440814 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: WARNING keystonemiddleware.auth_token [None req-fb6ffd77-cbb5-4ead-9396-499b986097f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:06:15.446069 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8f4a639c0 pid: 103442 (default app) Jul 12 13:07:32.276145 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:32.277949 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002201 Jul 12 13:07:32.279320 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:07:32.290757 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_api:SELECT=3 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:32.292023 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_cell0:SELECT=3 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:32.292858 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_cell1:SELECT=3 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:32.293872 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_cell0:SELECT=3 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:33.130211 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-04fdc575-5b65-4126-a665-60bd83bd4f8c admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:33.161883 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-04fdc575-5b65-4126-a665-60bd83bd4f8c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.876196 Jul 12 13:07:33.162668 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 12 13:07:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:07:35.420427 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:35.421454 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-97f11f86-b654-4588-af68-a7b6d8d94d89 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jul 12 13:07:35.421872 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:07:35.879965 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-0559888d-d1f1-4172-bcd3-7507988c1d77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "ram": 256, "disk": 1, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:35.899302 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:07:35.899302 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: warnings.warn(msg) Jul 12 13:07:35.933061 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-0559888d-d1f1-4172-bcd3-7507988c1d77 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.504353 Jul 12 13:07:35.934315 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:07:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:07:36.150347 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-cec04805-9995-4837-8678-2d80577aff5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:36.152827 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:07:36.152827 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: warnings.warn(msg) Jul 12 13:07:36.168215 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_api:SELECT=3 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:36.168577 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_cell0:SELECT=3 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:36.169310 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_cell1:SELECT=3 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:36.169990 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:07:36.235068 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-cec04805-9995-4837-8678-2d80577aff5b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291636 Jul 12 13:07:36.236694 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 12 13:07:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:07:38.457938 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-0559888d-d1f1-4172-bcd3-7507988c1d77 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:38.459592 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-0559888d-d1f1-4172-bcd3-7507988c1d77 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Jul 12 13:07:38.460008 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:07:39.130831 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-23213b99-a16f-4897-be20-dc78fd8d5154 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:39.148911 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:07:39.148911 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: warnings.warn(msg) Jul 12 13:07:39.171434 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-23213b99-a16f-4897-be20-dc78fd8d5154 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.705303 Jul 12 13:07:39.179314 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:07:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:07:39.185210 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-9f9deb3f-0037-4201-b451-ac4e5aa9b6f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:39.187554 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:07:39.187554 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: warnings.warn(msg) Jul 12 13:07:39.226754 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-9f9deb3f-0037-4201-b451-ac4e5aa9b6f7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045015 Jul 12 13:07:39.243044 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 12 13:07:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:07:41.488444 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-23213b99-a16f-4897-be20-dc78fd8d5154 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:41.489464 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-23213b99-a16f-4897-be20-dc78fd8d5154 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jul 12 13:07:41.489873 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:07:41.916427 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-e4a750e5-1ae1-4764-a9a9-b0ca1ace7d99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:41.935731 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-e4a750e5-1ae1-4764-a9a9-b0ca1ace7d99 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439790 Jul 12 13:07:41.936211 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:07:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:07:41.948697 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-47071504-512e-4912-ad8d-7a494fe6d27a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:41.973046 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-47071504-512e-4912-ad8d-7a494fe6d27a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028063 Jul 12 13:07:41.973683 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 12 13:07:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:07:44.238620 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-e4a750e5-1ae1-4764-a9a9-b0ca1ace7d99 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:44.239698 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-e4a750e5-1ae1-4764-a9a9-b0ca1ace7d99 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jul 12 13:07:44.240093 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:07:44.690931 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-726de641-00ff-4eb6-98f0-f9534b611dd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "swap": 0}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:44.711806 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-726de641-00ff-4eb6-98f0-f9534b611dd5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465718 Jul 12 13:07:44.712933 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:07:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:07:44.724915 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-93ee5176-3ee7-4ca5-aea8-e78ff9809122 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:44.750684 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-93ee5176-3ee7-4ca5-aea8-e78ff9809122 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029446 Jul 12 13:07:44.751986 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 12 13:07:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:07:46.943086 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-726de641-00ff-4eb6-98f0-f9534b611dd5 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:46.944166 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-726de641-00ff-4eb6-98f0-f9534b611dd5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 12 13:07:46.944777 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:07:47.378795 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-0bc4b33c-2349-4d7a-b1d0-6e3715eee929 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:47.398193 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-0bc4b33c-2349-4d7a-b1d0-6e3715eee929 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446205 Jul 12 13:07:47.405904 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:07:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:07:47.411247 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-ef6f32a3-dd0d-492b-87e4-def66318f6e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:47.436139 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-ef6f32a3-dd0d-492b-87e4-def66318f6e8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028928 Jul 12 13:07:47.436722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Tue Jul 12 13:07:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:07:50.169808 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-0bc4b33c-2349-4d7a-b1d0-6e3715eee929 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:50.170748 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-0bc4b33c-2349-4d7a-b1d0-6e3715eee929 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 12 13:07:50.171159 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:07:50.634989 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-a6cbed5a-5245-4a28-bca8-83154cdcae56 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:50.660774 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-a6cbed5a-5245-4a28-bca8-83154cdcae56 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.483012 Jul 12 13:07:50.661805 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 12 13:07:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:07:52.938627 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-0bc4b33c-2349-4d7a-b1d0-6e3715eee929 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:52.939720 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-0bc4b33c-2349-4d7a-b1d0-6e3715eee929 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001897 Jul 12 13:07:52.940187 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:07:53.380308 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-c6bd9f37-b820-4716-af2d-4b2a57e3243c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "rxtx_factor": 1.0}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:53.401541 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-c6bd9f37-b820-4716-af2d-4b2a57e3243c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.454420 Jul 12 13:07:53.401997 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:07:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:07:53.415489 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-6a42df88-3e48-47b8-8a45-785b756618c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:53.442640 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-6a42df88-3e48-47b8-8a45-785b756618c0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031148 Jul 12 13:07:53.443168 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 12 13:07:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:07:55.781561 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-c6bd9f37-b820-4716-af2d-4b2a57e3243c admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:55.782687 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-c6bd9f37-b820-4716-af2d-4b2a57e3243c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jul 12 13:07:55.783149 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:07:56.189903 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-4d74063c-1732-49bb-9395-e5d9b20f6af5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "disk": 20, "swap": 0, "name": "m1.small"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:56.210616 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-4d74063c-1732-49bb-9395-e5d9b20f6af5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421380 Jul 12 13:07:56.218120 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:07:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:07:56.223493 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-6f6f9487-dd40-4fd4-9303-a94c2b7b62ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:56.250720 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-6f6f9487-dd40-4fd4-9303-a94c2b7b62ef admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031153 Jul 12 13:07:56.251339 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 12 13:07:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:07:58.481337 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-4d74063c-1732-49bb-9395-e5d9b20f6af5 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:07:58.482312 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-4d74063c-1732-49bb-9395-e5d9b20f6af5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 12 13:07:58.482712 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:07:58.902939 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-74a381ec-2943-443b-ae53-24aafa0f680b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "id": "3", "disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:58.922527 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-74a381ec-2943-443b-ae53-24aafa0f680b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.433604 Jul 12 13:07:58.923613 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:07:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:07:58.935809 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-bf4aa974-4a7d-45a3-a823-88fecd0beea3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:07:58.962378 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-bf4aa974-4a7d-45a3-a823-88fecd0beea3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030275 Jul 12 13:07:58.975020 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 12 13:07:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:08:01.271359 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-74a381ec-2943-443b-ae53-24aafa0f680b admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:01.273009 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-74a381ec-2943-443b-ae53-24aafa0f680b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002124 Jul 12 13:08:01.283133 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:01.708837 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-bb122679-a886-499b-a6ee-aeeacdad2118 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:08:01.728627 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-bb122679-a886-499b-a6ee-aeeacdad2118 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.447319 Jul 12 13:08:01.728627 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:08:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:08:01.740361 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-0a32cb82-4865-4874-9a1d-bf9937222616 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:08:01.767837 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-0a32cb82-4865-4874-9a1d-bf9937222616 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031516 Jul 12 13:08:01.768768 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 12 13:08:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:08:04.046927 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-bb122679-a886-499b-a6ee-aeeacdad2118 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:04.048025 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-bb122679-a886-499b-a6ee-aeeacdad2118 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jul 12 13:08:04.048436 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:08:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:08:04.473739 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-bd29b721-1217-498d-a6c7-f6f60a5eceb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:08:04.493680 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-bd29b721-1217-498d-a6c7-f6f60a5eceb7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.438673 Jul 12 13:08:04.494145 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Tue Jul 12 13:08:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:08:04.506152 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-2883118b-02a2-4ca7-8c73-7955bab27309 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:08:04.509766 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:08:04.531981 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-2883118b-02a2-4ca7-8c73-7955bab27309 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029497 Jul 12 13:08:04.539344 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Tue Jul 12 13:08:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:08:24.108267 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-bd29b721-1217-498d-a6c7-f6f60a5eceb7 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:24.109274 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-bd29b721-1217-498d-a6c7-f6f60a5eceb7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 12 13:08:24.109648 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:08:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:24.558119 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-9dcfdc88-3626-475a-911d-e2f54ca51ad1 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:24.575319 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-9dcfdc88-3626-475a-911d-e2f54ca51ad1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.458822 Jul 12 13:08:24.575841 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 12 13:08:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:08:25.652250 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-bd29b721-1217-498d-a6c7-f6f60a5eceb7 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:25.653262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-bd29b721-1217-498d-a6c7-f6f60a5eceb7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 12 13:08:25.653746 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:26.202461 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-cc24a30e-8b86-4f50-a419-e7ed2cb2fd8b admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:26.208420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.wsgi [None req-cc24a30e-8b86-4f50-a419-e7ed2cb2fd8b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-cc24a30e-8b86-4f50-a419-e7ed2cb2fd8b admin admin] Request method failure captured: Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Accept: application/json Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Accept-Encoding: gzip, deflate Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Connection: keep-alive Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Content-Length: 0 Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Host: 10.222.0.33 Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Openstack-Api-Version: compute 2.90 Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Openstack-System-Scope: None Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: User-Agent: python-novaclient Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Auth-Token: gAAAAABizXJJZwEadZ9bGKNqS2Sb2Y0MNbJdd0Sc7t5kR2piflmYgDw23jIOfDCeyzVjsb8GPSWTEtLcygq47F90yQFIkHA2QWWyeCe_8Bfu06oJ1I9OHVgBTMUIL-Q3Isu11MPtpsIcwN_C1MuhyqcgYi52EgbBJSQuz8QYZ3IOhnOx_-PnDWk Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Domain-Id: None Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Domain-Name: None Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Identity-Status: Confirmed Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Is-Admin-Project: True Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Domain-Id: default Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Domain-Name: Default Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Name: admin Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Role: admin,reader,member Jul 12 13:08:26.211732 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Roles: admin,reader,member Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/794d24e27fab441687250f716c23e178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_794d24e27fab441687250f716c23e178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Tenant: admin Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Tenant-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Tenant-Name: admin Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User: admin Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Domain-Id: default Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Domain-Name: Default Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Id: 2760ab07716f4468bd78fa0e80e71165 Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Name: admin Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: method: > Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: exception: Flavor 42 could not be found. Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: action_args: {'id': '42'} Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:08:26.213492 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:26.214420 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.215890 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-cc24a30e-8b86-4f50-a419-e7ed2cb2fd8b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:08:26.217153 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-cc24a30e-8b86-4f50-a419-e7ed2cb2fd8b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.423536 Jul 12 13:08:26.217153 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 12 13:08:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:08:26.223806 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-f92a67a2-7dc5-4e58-8ff2-8fa52c5c93d1 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:26.226844 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:08:26.247059 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-f92a67a2-7dc5-4e58-8ff2-8fa52c5c93d1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027084 Jul 12 13:08:26.247612 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 12 13:08:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:08:26.257694 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-10666a30-a6bd-4413-a9bc-089878570fca admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:26.279183 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-10666a30-a6bd-4413-a9bc-089878570fca admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025229 Jul 12 13:08:26.279718 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 12 13:08:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:08:26.289519 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-8ccc8622-73ab-4d57-a669-4036813e0ee9 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:26.295478 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.wsgi [None req-8ccc8622-73ab-4d57-a669-4036813e0ee9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-8ccc8622-73ab-4d57-a669-4036813e0ee9 admin admin] Request method failure captured: Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Accept: application/json Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Accept-Encoding: gzip, deflate Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Connection: keep-alive Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Content-Length: 0 Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Host: 10.222.0.33 Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Openstack-Api-Version: compute 2.90 Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Openstack-System-Scope: None Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: User-Agent: python-novaclient Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Auth-Token: gAAAAABizXJJZwEadZ9bGKNqS2Sb2Y0MNbJdd0Sc7t5kR2piflmYgDw23jIOfDCeyzVjsb8GPSWTEtLcygq47F90yQFIkHA2QWWyeCe_8Bfu06oJ1I9OHVgBTMUIL-Q3Isu11MPtpsIcwN_C1MuhyqcgYi52EgbBJSQuz8QYZ3IOhnOx_-PnDWk Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Domain-Id: None Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Domain-Name: None Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Identity-Status: Confirmed Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Is-Admin-Project: True Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Domain-Id: default Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Domain-Name: Default Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Name: admin Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Role: admin,reader,member Jul 12 13:08:26.298927 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Roles: admin,reader,member Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/794d24e27fab441687250f716c23e178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_794d24e27fab441687250f716c23e178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Tenant: admin Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Tenant-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Tenant-Name: admin Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User: admin Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Domain-Id: default Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Domain-Name: Default Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Id: 2760ab07716f4468bd78fa0e80e71165 Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Name: admin Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: method: > Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: exception: Flavor 42 could not be found. Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: action_args: {'id': '42'} Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:08:26.300268 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:26.301389 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:26.302722 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-8ccc8622-73ab-4d57-a669-4036813e0ee9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:08:26.303940 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-8ccc8622-73ab-4d57-a669-4036813e0ee9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014699 Jul 12 13:08:26.303940 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 12 13:08:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 13:08:27.291232 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-10666a30-a6bd-4413-a9bc-089878570fca admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:27.292301 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-10666a30-a6bd-4413-a9bc-089878570fca admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jul 12 13:08:27.292699 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:27.863926 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-f41ac1ea-9155-489d-95a3-b78d1c981a91 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:27.870322 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.wsgi [None req-f41ac1ea-9155-489d-95a3-b78d1c981a91 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-f41ac1ea-9155-489d-95a3-b78d1c981a91 admin admin] Request method failure captured: Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Accept: application/json Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Accept-Encoding: gzip, deflate Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Connection: keep-alive Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Content-Length: 0 Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Host: 10.222.0.33 Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Openstack-Api-Version: compute 2.90 Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Openstack-System-Scope: None Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: User-Agent: python-novaclient Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Auth-Token: gAAAAABizXJLmCjqB7yM3Pmpmzsh2q0gllGNntOejOGAl-JK2tgCBcUilqBnjg-tXg8Ch9D8BtTETXc7CO22nzAJcxiSA5jJLoNGfDjxpAyFHFR7dPhF9vrVrask5e-m7a3KjZyH45Ed69bAPhMQRVRJMUcVUPT-b5y9tWnsFoiPoqgxLozx94c Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Domain-Id: None Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Domain-Name: None Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Identity-Status: Confirmed Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Is-Admin-Project: True Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Domain-Id: default Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Domain-Name: Default Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Name: admin Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Role: admin,reader,member Jul 12 13:08:27.871879 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Roles: admin,reader,member Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/794d24e27fab441687250f716c23e178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_794d24e27fab441687250f716c23e178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Tenant: admin Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Tenant-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Tenant-Name: admin Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User: admin Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Domain-Id: default Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Domain-Name: Default Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Id: 2760ab07716f4468bd78fa0e80e71165 Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Name: admin Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: method: > Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: exception: Flavor 84 could not be found. Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: action_args: {'id': '84'} Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:08:27.873253 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:27.874029 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.875704 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-f41ac1ea-9155-489d-95a3-b78d1c981a91 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:08:27.877484 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-f41ac1ea-9155-489d-95a3-b78d1c981a91 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.444694 Jul 12 13:08:27.877484 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 12 13:08:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:08:27.885223 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-9e79357c-1ca9-4a73-9923-ac48e59bb689 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:27.899066 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-9e79357c-1ca9-4a73-9923-ac48e59bb689 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017543 Jul 12 13:08:27.899591 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 12 13:08:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:08:27.909116 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-87fe434c-34e5-49dc-90b9-8939895e9604 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:27.923379 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-87fe434c-34e5-49dc-90b9-8939895e9604 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017651 Jul 12 13:08:27.924062 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 12 13:08:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:08:27.937129 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-0ac77a9c-c3c7-4919-ab01-106b1fa80131 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:27.944773 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.wsgi [None req-0ac77a9c-c3c7-4919-ab01-106b1fa80131 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-0ac77a9c-c3c7-4919-ab01-106b1fa80131 admin admin] Request method failure captured: Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Accept: application/json Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Accept-Encoding: gzip, deflate Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Connection: keep-alive Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Content-Length: 0 Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Host: 10.222.0.33 Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Openstack-Api-Version: compute 2.90 Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Openstack-System-Scope: None Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: User-Agent: python-novaclient Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Auth-Token: gAAAAABizXJLmCjqB7yM3Pmpmzsh2q0gllGNntOejOGAl-JK2tgCBcUilqBnjg-tXg8Ch9D8BtTETXc7CO22nzAJcxiSA5jJLoNGfDjxpAyFHFR7dPhF9vrVrask5e-m7a3KjZyH45Ed69bAPhMQRVRJMUcVUPT-b5y9tWnsFoiPoqgxLozx94c Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Domain-Id: None Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Domain-Name: None Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Identity-Status: Confirmed Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Is-Admin-Project: True Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Domain-Id: default Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Domain-Name: Default Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Name: admin Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Role: admin,reader,member Jul 12 13:08:27.946297 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Roles: admin,reader,member Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/794d24e27fab441687250f716c23e178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_794d24e27fab441687250f716c23e178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Tenant: admin Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Tenant-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Tenant-Name: admin Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User: admin Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Domain-Id: default Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Domain-Name: Default Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Id: 2760ab07716f4468bd78fa0e80e71165 Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Name: admin Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: method: > Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: exception: Flavor 84 could not be found. Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: action_args: {'id': '84'} Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:08:27.947774 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:27.948916 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:27.950505 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-0ac77a9c-c3c7-4919-ab01-106b1fa80131 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:08:27.952204 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-0ac77a9c-c3c7-4919-ab01-106b1fa80131 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017473 Jul 12 13:08:27.952204 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Jul 12 13:08:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:08:28.945437 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-87fe434c-34e5-49dc-90b9-8939895e9604 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:28.946462 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-87fe434c-34e5-49dc-90b9-8939895e9604 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 12 13:08:28.946860 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:08:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:29.526301 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-8b6248e1-e9d2-443b-9f44-98c71a7b7190 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:29.534650 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.wsgi [None req-8b6248e1-e9d2-443b-9f44-98c71a7b7190 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-8b6248e1-e9d2-443b-9f44-98c71a7b7190 admin admin] Request method failure captured: Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Accept: application/json Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Accept-Encoding: gzip, deflate Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Connection: keep-alive Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Content-Length: 0 Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Host: 10.222.0.33 Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Openstack-Api-Version: compute 2.90 Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Openstack-System-Scope: None Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: User-Agent: python-novaclient Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Auth-Token: gAAAAABizXJMFUFvk14S-YgI9o1jrYDrIoRZUZU6FmlbDMwedxdNyX80aB4mS6QUgpFUWi5R2J4pXYv6ByW8ObEKPqUIA-ZA3h9QxbdS0fxxIEp-L5UNo1XqfVXfieOQJRxcoDf2FZrcyQ_e8ug88kVB-ELXU5znyr6COvuEdq4meAFxe8COAmU Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Domain-Id: None Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Domain-Name: None Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Identity-Status: Confirmed Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Is-Admin-Project: True Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Domain-Id: default Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Domain-Name: Default Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Project-Name: admin Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Role: admin,reader,member Jul 12 13:08:29.536948 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Roles: admin,reader,member Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/794d24e27fab441687250f716c23e178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_794d24e27fab441687250f716c23e178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Tenant: admin Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Tenant-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-Tenant-Name: admin Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User: admin Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Domain-Id: default Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Domain-Name: Default Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Id: 2760ab07716f4468bd78fa0e80e71165 Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: X-User-Name: admin Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: method: > Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: exception: Flavor 451 could not be found. Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: action_args: {'id': '451'} Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:08:29.538439 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:29.539349 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.540733 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-8b6248e1-e9d2-443b-9f44-98c71a7b7190 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:08:29.541982 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-8b6248e1-e9d2-443b-9f44-98c71a7b7190 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.451498 Jul 12 13:08:29.541982 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 12 13:08:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:08:29.548207 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-ecc1ca94-37f2-4180-be17-c35c08c90a59 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:29.562137 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-ecc1ca94-37f2-4180-be17-c35c08c90a59 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017537 Jul 12 13:08:29.562677 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 12 13:08:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:08:29.572827 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:29.587897 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018852 Jul 12 13:08:29.588413 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Jul 12 13:08:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:08:29.597924 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-f4eca740-0e9c-4911-aa50-31e09a86e9aa admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:29.604189 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.wsgi [None req-f4eca740-0e9c-4911-aa50-31e09a86e9aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-f4eca740-0e9c-4911-aa50-31e09a86e9aa admin admin] Request method failure captured: Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Accept: application/json Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Accept-Encoding: gzip, deflate Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Connection: keep-alive Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Content-Length: 0 Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Host: 10.222.0.33 Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Openstack-Api-Version: compute 2.90 Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Openstack-System-Scope: None Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: User-Agent: python-novaclient Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Auth-Token: gAAAAABizXJMFUFvk14S-YgI9o1jrYDrIoRZUZU6FmlbDMwedxdNyX80aB4mS6QUgpFUWi5R2J4pXYv6ByW8ObEKPqUIA-ZA3h9QxbdS0fxxIEp-L5UNo1XqfVXfieOQJRxcoDf2FZrcyQ_e8ug88kVB-ELXU5znyr6COvuEdq4meAFxe8COAmU Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Domain-Id: None Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Domain-Name: None Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Identity-Status: Confirmed Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Is-Admin-Project: True Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Domain-Id: default Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Domain-Name: Default Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Project-Name: admin Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Role: admin,reader,member Jul 12 13:08:29.605699 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Roles: admin,reader,member Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/794d24e27fab441687250f716c23e178"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_794d24e27fab441687250f716c23e178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/794d24e27fab441687250f716c23e178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Tenant: admin Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Tenant-Id: 794d24e27fab441687250f716c23e178 Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-Tenant-Name: admin Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User: admin Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Domain-Id: default Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Domain-Name: Default Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Id: 2760ab07716f4468bd78fa0e80e71165 Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: X-User-Name: admin Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: method: > Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: exception: Flavor 451 could not be found. Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: action_args: {'id': '451'} Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:08:29.607220 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:29.608262 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: ERROR nova.api.openstack.wsgi Jul 12 13:08:29.609494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-f4eca740-0e9c-4911-aa50-31e09a86e9aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:08:29.610731 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-f4eca740-0e9c-4911-aa50-31e09a86e9aa admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012701 Jul 12 13:08:29.610731 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 12 13:08:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:08:30.586973 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:30.587987 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jul 12 13:08:30.588360 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:31.202052 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-38167a1c-d8fe-4457-914f-ba007816415d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:08:31.222137 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-38167a1c-d8fe-4457-914f-ba007816415d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.496056 Jul 12 13:08:31.222717 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Jul 12 13:08:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:08:32.247026 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:32.248309 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Jul 12 13:08:32.248829 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:32.811067 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-97fff889-3539-4ac3-94e2-afe7e55929d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:08:32.836363 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-97fff889-3539-4ac3-94e2-afe7e55929d7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.446740 Jul 12 13:08:32.836891 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Jul 12 13:08:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:08:33.827455 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:33.828482 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 12 13:08:33.828865 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:08:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:34.397494 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-c272d06e-87b9-4c4b-8c6b-c4d3b12843da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:08:34.417328 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-c272d06e-87b9-4c4b-8c6b-c4d3b12843da admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.447634 Jul 12 13:08:34.417887 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Jul 12 13:08:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:08:35.412378 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:35.413393 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 12 13:08:35.413786 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:08:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:35.961726 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-4baf6832-6761-4962-8fa1-c82425039638 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:08:35.985733 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-4baf6832-6761-4962-8fa1-c82425039638 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.432103 Jul 12 13:08:35.986276 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Jul 12 13:08:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:08:37.003734 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:37.004749 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 12 13:08:37.005148 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:08:37.588483 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-82a42c64-19c1-47a9-afc3-8ff604b61ac7 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:08:37.611344 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-82a42c64-19c1-47a9-afc3-8ff604b61ac7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.470382 Jul 12 13:08:37.611886 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Tue Jul 12 13:08:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:09:30.220308 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:09:30.221320 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-239bedca-d705-45c1-92a5-4acff1076cdc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 12 13:09:30.221711 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Tue Jul 12 13:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:09:30.235083 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:30.634087 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-bf2dff25-24d6-44ca-8732-642bb18d5b20 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:09:30.653468 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-bf2dff25-24d6-44ca-8732-642bb18d5b20 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.425000 Jul 12 13:09:30.653997 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Tue Jul 12 13:09:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:09:30.677406 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:09:30.683262 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-eb2bee02-d1da-4da9-9425-6a3639ae2a20 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:09:30.691819 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-eb2bee02-d1da-4da9-9425-6a3639ae2a20 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016784 Jul 12 13:09:30.692363 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Tue Jul 12 13:09:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:09:30.704524 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-1c1ba2df-9de9-4388-9fb7-24a0a52822ae admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:09:30.712952 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-1c1ba2df-9de9-4388-9fb7-24a0a52822ae admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011971 Jul 12 13:09:30.713643 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Tue Jul 12 13:09:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:09:30.729044 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:09:30.740328 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018240 Jul 12 13:09:30.741111 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Tue Jul 12 13:09:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:09:30.752738 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-d87323da-f032-4ef0-8670-62ade1ea3246 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:09:30.760536 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-d87323da-f032-4ef0-8670-62ade1ea3246 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011328 Jul 12 13:09:30.760973 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Tue Jul 12 13:09:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:12:57.647436 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:12:57.648452 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 12 13:12:57.648849 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:12:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:12:57.788974 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_api:SELECT=6 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:12:57.963904 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-067bce4d-9f6b-4ada-8ecd-0f9def05ffc1 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:12:57.965851 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:12:57.965851 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: warnings.warn(msg) Jul 12 13:12:57.967623 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-067bce4d-9f6b-4ada-8ecd-0f9def05ffc1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:12:57.968169 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-067bce4d-9f6b-4ada-8ecd-0f9def05ffc1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:12:57.969366 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-067bce4d-9f6b-4ada-8ecd-0f9def05ffc1 admin admin] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:12:57.969940 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-067bce4d-9f6b-4ada-8ecd-0f9def05ffc1 admin admin] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:12:58.010154 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-067bce4d-9f6b-4ada-8ecd-0f9def05ffc1 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.222764 Jul 12 13:12:58.010764 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 12 13:12:57 2022] GET /compute/v2.1/os-services => generated 794 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:12:58.862361 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:12:58.863407 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 12 13:12:58.863808 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:12:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:12:59.070465 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-63e5e61f-2190-4a72-96fb-af0c491298e9 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:12:59.071682 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:12:59.071682 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: warnings.warn(msg) Jul 12 13:12:59.072873 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-63e5e61f-2190-4a72-96fb-af0c491298e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:12:59.073311 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-63e5e61f-2190-4a72-96fb-af0c491298e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:12:59.074090 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-63e5e61f-2190-4a72-96fb-af0c491298e9 admin admin] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:12:59.074523 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-63e5e61f-2190-4a72-96fb-af0c491298e9 admin admin] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:12:59.094050 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-63e5e61f-2190-4a72-96fb-af0c491298e9 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.091590 Jul 12 13:12:59.094615 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 12 13:12:59 2022] GET /compute/v2.1/os-services => generated 794 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:13:10.369760 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:13:10.371035 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001910 Jul 12 13:13:10.371538 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:13:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:13:10.516896 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_cell0:SELECT=4 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:10.517726 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_cell1:SELECT=4 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:10.518707 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG dbcounter [-] [103443] Writing DB stats nova_api:SELECT=8 {{(pid=103443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:13:10.576111 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-0b2e4ff7-4ae2-4d39-87e6-f20ca7896e36 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:13:10.577914 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:10.577914 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: warnings.warn(msg) Jul 12 13:13:10.579782 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-0b2e4ff7-4ae2-4d39-87e6-f20ca7896e36 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:13:10.580492 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-0b2e4ff7-4ae2-4d39-87e6-f20ca7896e36 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:13:10.581703 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-0b2e4ff7-4ae2-4d39-87e6-f20ca7896e36 admin admin] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:13:10.582347 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-0b2e4ff7-4ae2-4d39-87e6-f20ca7896e36 admin admin] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:13:10.625051 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-0b2e4ff7-4ae2-4d39-87e6-f20ca7896e36 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.115814 Jul 12 13:13:10.625626 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 12 13:13:10 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:13:11.503971 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:13:11.504971 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-8b274c30-a945-49de-95c6-f20ddd0774be admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 12 13:13:11.505361 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Jul 12 13:13:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:13:11.722643 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG nova.api.openstack.wsgi [None req-4a075428-bac0-4cc9-94b8-7c4fb4006367 admin admin] Calling method '>' {{(pid=103443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:13:11.724330 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:13:11.724330 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: warnings.warn(msg) Jul 12 13:13:11.726585 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-4a075428-bac0-4cc9-94b8-7c4fb4006367 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:13:11.727186 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-4a075428-bac0-4cc9-94b8-7c4fb4006367 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:13:11.729683 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-4a075428-bac0-4cc9-94b8-7c4fb4006367 admin admin] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:13:11.730657 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: DEBUG oslo_concurrency.lockutils [None req-4a075428-bac0-4cc9-94b8-7c4fb4006367 admin admin] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:13:11.759743 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: INFO nova.api.openstack.requestlog [None req-4a075428-bac0-4cc9-94b8-7c4fb4006367 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.111962 Jul 12 13:13:11.760500 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: [pid: 103443|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Jul 12 13:13:11 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:14:09.404370 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: Tue Jul 12 13:14:09 2022 - graceful shutdown triggered... Jul 12 13:14:09.404508 dv-cinder-797608-55-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 13:14:09.405438 dv-cinder-797608-55-iscsi devstack@n-api.service[103442]: Gracefully killing worker 1 (pid: 103442)... Jul 12 13:14:09.405888 dv-cinder-797608-55-iscsi devstack@n-api.service[103443]: Gracefully killing worker 2 (pid: 103443)... Jul 12 13:14:10.406702 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: worker 1 buried after 1 seconds Jul 12 13:14:10.407586 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: worker 2 buried after 1 seconds Jul 12 13:14:10.407586 dv-cinder-797608-55-iscsi devstack@n-api.service[103441]: goodbye to uWSGI. Jul 12 13:14:10.409595 dv-cinder-797608-55-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 13:14:10.410488 dv-cinder-797608-55-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 13:14:10.414332 dv-cinder-797608-55-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 13:14:10.425735 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 13:14:10 2022] *** Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: nodename: dv-cinder-797608-55-iscsi Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: machine: x86_64 Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: clock source: unix Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: pcre jit disabled Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: detected number of CPU cores: 4 Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: current working directory: / Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: detected binary path: /usr/bin/uwsgi-core Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: your processes number limit is 47680 Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: your memory page size is 4096 bytes Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: detected max file descriptor number: 2048 Jul 12 13:14:10.428847 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: lock engine: pthread robust mutexes Jul 12 13:14:10.429823 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: thunder lock: enabled Jul 12 13:14:10.429823 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 13:14:10.429823 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 13:14:10.472360 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: Python main interpreter initialized at 0x5568fd5b59c0 Jul 12 13:14:10.472360 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: python threads support enabled Jul 12 13:14:10.472360 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: your server socket listen backlog is limited to 100 connections Jul 12 13:14:10.472360 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: your mercy for graceful operations on workers is 90 seconds Jul 12 13:14:10.472809 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 13:14:10.472809 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: *** Operational MODE: preforking *** Jul 12 13:14:10.473064 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: *** uWSGI is running in multiple interpreter mode *** Jul 12 13:14:10.473064 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: spawned uWSGI master process (pid: 117943) Jul 12 13:14:10.473288 dv-cinder-797608-55-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 13:14:10.485252 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: spawned uWSGI worker 1 (pid: 117962, cores: 1) Jul 12 13:14:10.485252 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: spawned uWSGI worker 2 (pid: 117963, cores: 1) Jul 12 13:14:10.485252 dv-cinder-797608-55-iscsi devstack@n-api.service[117943]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 13:14:11.128682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:14:11.133542 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:14:12.317637 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:14:12.317637 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: from cryptography.utils import int_from_bytes Jul 12 13:14:12.318303 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:14:12.318303 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: from cryptography.utils import int_from_bytes Jul 12 13:14:12.322087 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:14:12.322087 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: from cryptography.utils import int_from_bytes Jul 12 13:14:12.322636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:14:12.322636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: from cryptography.utils import int_from_bytes Jul 12 13:14:14.686564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:14:14.687301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:14:14.687389 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:14:14.687688 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:14:14.687941 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:14:14.688328 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.688653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.688999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.689312 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.689639 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.689949 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.690267 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.690554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.690897 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.691190 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.691500 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.691820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-55-iscsi {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.692124 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.692924 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.692924 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.693101 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.693525 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.693700 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.693974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.694481 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.695900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.695900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.695900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.696178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.696472 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.696758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.697084 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.697395 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.697720 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.698041 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.698424 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-55-iscsi {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.698724 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.699059 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.699375 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.699818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.700172 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.700420 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.700702 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.701023 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.701336 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.701678 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.701989 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.702330 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.702590 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.702909 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.703238 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.703544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.703863 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.704163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.704475 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.704691 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.704996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.705334 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.705646 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.705969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.706217 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.706464 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.706778 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.707117 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.707421 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.707720 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.708021 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.708319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.708624 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.708957 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.709314 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.709619 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.710035 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.710351 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.710674 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.711005 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.711314 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.711720 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.711962 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.712282 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.712619 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.712918 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.713222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.713581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.713956 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.714159 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.714500 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.714815 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.715077 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.715411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.715816 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.715992 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.716258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.716545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.716889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.717194 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.717495 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.717691 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:14:14.718231 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.718408 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:14:14.718562 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.718562 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.718877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:14:14.719069 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.719237 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:14:14.719380 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.719527 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:14:14.719675 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.719830 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.719988 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.720168 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.720325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.720325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.720633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.720814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.720987 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.721166 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.721317 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.721484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.721639 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.721788 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.721940 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.722105 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.722277 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.722417 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.722599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.723237 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.723413 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.723570 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.723712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.723859 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.724006 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-55-iscsi {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.724148 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.724349 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.724674 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.724832 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.725311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.725483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.725633 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.725809 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.725971 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.726113 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.726253 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.726817 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.726994 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.727157 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.727333 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.727479 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.727644 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.727796 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.727945 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.728105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.728245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.728383 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.728571 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.728751 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.728909 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.729060 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.729200 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.729347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.729493 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.729640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.729788 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.729928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.730076 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.730230 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.730381 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.730566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.730721 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.730721 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.731019 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-55-iscsi {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.731166 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.731315 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.731529 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.731675 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.731822 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.731980 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.732130 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.732285 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.732433 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.732649 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.733303 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.733457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.733605 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.733797 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.733939 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.734079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.734226 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.734368 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.734518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.734672 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.734820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.734988 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.735284 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.735434 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.735625 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.735798 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.735942 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.736082 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.736228 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.736381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.736649 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.737015 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.737177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.737320 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.737467 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.737607 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.737765 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.737950 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.738090 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.738230 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.738368 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.738507 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.738654 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.738815 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.738985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.739133 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.739272 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.739426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.739571 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.739758 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.739937 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.740095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.740498 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.740688 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.740835 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.741069 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.741239 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.741392 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.741549 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.741700 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.741848 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.742034 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.742187 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.742327 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.742327 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.742621 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.742772 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.742927 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.743534 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.748314 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.749587 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.749755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.749910 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.750067 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.750067 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.750403 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.750545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.750695 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.750843 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.751050 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.751210 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.751360 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.751500 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.751654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.751801 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.751942 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.752091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.752232 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.752379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.752534 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.752676 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.752857 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.753010 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.753169 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.753366 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.753536 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.753685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.753826 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.753965 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.754247 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.754847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.755031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.755186 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.755328 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.755482 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.755640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.755863 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.756260 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.756440 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.756592 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.756740 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.756889 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.757055 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.757231 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.757376 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.757525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.757665 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.757812 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.757965 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.758115 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.758297 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.758450 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.758597 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.758748 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.758899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.759073 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.759221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.759361 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.759512 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.759666 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.759814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.759961 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.760106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.760250 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.760388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.760538 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.760686 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.760837 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.761023 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.761168 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.761314 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.761463 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.761613 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.761767 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.761908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.762047 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.762194 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.762334 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.762482 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.762624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.762782 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.762931 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.763105 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.763384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.763554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.763699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.763839 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.763992 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.764132 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.764361 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.764789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.765105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.765302 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.765467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.765609 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.765750 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.765901 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.766048 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.766357 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.766464 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.766559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.766720 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.766814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.766909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.767028 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.767122 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.767206 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.767296 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.767417 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.767532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.767653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.767770 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.767879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.767986 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.768100 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.768221 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.768330 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.768447 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.768555 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.768670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.768786 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.768978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.769143 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.769252 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.769358 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.769473 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.769588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.769711 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.769820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.769820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.770041 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.770151 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.770258 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.770378 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.770494 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.770610 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.770718 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.770834 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.770985 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.771102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.771244 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.771400 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.771560 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:14:14.771693 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.771833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.771943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.772065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.772182 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.772297 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.772403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.772523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.772631 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.772738 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.772854 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.772962 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.773075 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.773192 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.773355 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.773544 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.773657 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.773782 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.774027 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.774161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.774280 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.774496 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.774626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.775037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.775359 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.775476 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.775592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.775708 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.775823 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.775931 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.776051 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.776168 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.776406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.776406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.776406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.776406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.776406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.777142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.777296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.777451 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.777592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.777741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.777888 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.778029 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.778168 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.778316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.778468 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.778619 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.778761 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.778907 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.779127 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.779271 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.779422 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.780176 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.780331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.780331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.780749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.780892 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.781033 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.781187 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.781335 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.781487 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.781633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.781774 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.781935 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.782084 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.782232 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.782380 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.782555 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.782699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.782699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.783032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.783187 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.783336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.783476 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.783749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.783911 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.784075 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.784215 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.784369 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.784528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.784759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.785174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.785513 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.785672 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.785817 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.785958 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.786111 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.786253 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.786411 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.786636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.786792 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.786940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.787142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.787293 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.787443 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.787592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.787732 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.787965 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.788131 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.788273 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.788414 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.788562 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.788716 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.788857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.789006 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.789157 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.789305 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.789490 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.789641 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.789791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.789943 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.790092 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.790241 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.790396 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.790575 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.790747 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.790901 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.791112 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.791256 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.791395 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.791395 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.791677 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.791817 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.791964 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.792105 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.792251 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.792399 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.792581 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.792863 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.793011 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.793202 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.793348 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.793495 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.793649 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.793873 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.794028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.794177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.794325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.794479 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.794628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.794875 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.795290 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.795462 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.795785 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.795938 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.796080 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.796229 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.796370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.796846 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.797061 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.797217 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.797359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.797507 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.797658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.797798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.797945 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.798098 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.798246 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.798388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.798536 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.798677 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.798890 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.799082 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.799082 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.799370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.799528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.799687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.799837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.799985 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.800125 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.800273 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.800421 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.800562 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.800713 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.800863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.801003 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.801142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.801288 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.801441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.801589 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.801737 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.801883 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.802033 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.802033 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.802319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.802469 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.802630 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.802800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.802941 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.803109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.803261 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.803421 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.803569 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.803710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.803878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.804098 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.804813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.805063 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.805507 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.805840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.805998 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.806141 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.806292 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.806433 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.806583 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.806771 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.806924 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.807741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.807889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.808031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.808171 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.808320 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.808461 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.808609 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.808752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.808893 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.809052 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.809208 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.809402 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.809552 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.809701 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.809852 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.810007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.810156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.810296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.810296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.810579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.810738 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.810895 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.811067 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.811221 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.811370 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.811519 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.811659 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.811807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.811949 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.812089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.812235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.812383 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.812531 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.812681 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.812821 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.812977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.813117 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.813264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.813404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.813558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.813708 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.813848 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.813996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.814222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.814379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.814522 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.814661 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.814810 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.815013 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.815242 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.815656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.815829 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.816141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.816305 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.816447 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.816588 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.816588 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.816874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.817023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.817266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.817433 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.817588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.817822 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.817977 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.818126 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.818377 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.818527 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.818677 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.818828 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.819580 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.819744 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.819894 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.820052 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.820200 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.820341 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.820494 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.820636 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.820783 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.820945 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.821351 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.821498 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.821691 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.821845 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.821986 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.822144 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.822296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.822296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.822577 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.822718 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.822912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.823089 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.823241 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.823383 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.823537 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.823677 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.823818 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.823957 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.824115 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.824400 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.824553 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.824694 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.824842 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.824990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.825133 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.825421 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.825943 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.826094 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.826455 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.826606 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.826747 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.826913 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.827092 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.827243 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.827385 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.827525 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.827674 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.827846 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.828080 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.828242 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.828392 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.828533 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.828689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.828842 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.829008 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.829149 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.829290 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.829440 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.829591 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.829741 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.829883 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.830030 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.830171 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.830318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.830473 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.830621 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.833752 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.834372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.834639 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.834798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.835005 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.835103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.835204 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.835292 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.835393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.835559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.835676 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.836040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.836040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.836217 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.836310 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.836442 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.836681 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.836792 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.836880 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.836965 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837049 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837146 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837232 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837408 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837583 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837822 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.837999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838102 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838102 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838274 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838526 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838618 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838836 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.838930 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839033 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839131 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839225 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839225 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839390 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839474 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839560 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839643 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839833 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.839920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.840012 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.840106 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.840484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.840643 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.840746 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.840842 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.840934 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.840934 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841097 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841194 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841280 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841516 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841602 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841685 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841776 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841868 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.841960 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842044 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842227 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842320 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842412 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842497 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842580 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842670 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842767 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.842859 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843213 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843298 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843390 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843555 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843729 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.843987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844078 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844168 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844265 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844432 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844520 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844619 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844718 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844811 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844895 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.844980 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.845070 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.845161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.845256 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.845348 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.845433 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.845523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.845607 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.845690 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.845779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.846032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.846132 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.846226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.846318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.846412 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.846505 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.846596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.846836 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.846941 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847057 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847329 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847501 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847676 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847676 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847844 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.847929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.848012 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.848094 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.848190 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.848282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.848431 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.848549 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.848659 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.849371 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.849475 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.849610 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.849686 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.849757 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.849827 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.849906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.849998 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850082 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850165 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850236 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850511 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850594 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850777 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.850862 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851088 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851189 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851288 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851565 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851650 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851834 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851834 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.851996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852179 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852262 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852352 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852445 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852580 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852767 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852858 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.852951 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.853036 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.853164 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.853283 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.853392 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.853507 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.853625 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.853743 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.853861 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.853979 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.854094 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.854210 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.854318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.854424 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.854545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.854654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.854759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.854867 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.855000 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.855129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.855253 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.855362 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.855477 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.855593 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.855707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.855824 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.855942 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.856210 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.856335 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.856446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.856561 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.856679 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.856813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.857096 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.857207 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.857315 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.857448 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.857568 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.857684 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.857778 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.857870 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.857963 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858047 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858140 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858225 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858399 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858561 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858646 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858727 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858799 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.858881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859017 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859017 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859275 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859362 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859457 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859632 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859731 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859815 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.859990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860081 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860172 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860269 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860354 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860437 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860520 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860781 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860873 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.860966 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861058 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861160 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861346 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861431 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861514 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861605 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861797 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861882 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.861966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862056 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862149 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862235 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862511 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862678 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862761 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862852 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.862937 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.863090 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.863210 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.863326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.863450 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.863559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.863559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.863559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.863559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.863559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864060 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864285 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864393 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864577 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864848 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.864931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.865290 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.865400 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.865476 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.865548 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.865628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.865714 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.865794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.865866 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.866069 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.866303 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.866399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.866500 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.866595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.866680 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.866772 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.866857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.867289 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.867449 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.867564 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.867672 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.867781 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.867888 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868224 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868393 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868578 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868757 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.868923 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.869014 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.869111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.869197 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.869295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.869396 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.869480 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.869564 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.869664 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.870258 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.870367 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.870462 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.870548 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.870644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.870729 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.870822 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.870908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871008 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871205 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871299 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871467 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871642 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871739 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871833 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.871918 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872092 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872182 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872360 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872445 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872618 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872809 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.872982 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.873066 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.873156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.873307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.873393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.873514 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.873617 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.873710 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.873804 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.873897 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874002 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874083 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874155 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874227 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874494 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874577 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874660 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874841 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.874926 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.875165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.875261 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.875479 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.875570 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.875792 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.875893 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.876108 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.876200 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.876440 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.876553 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.876713 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.876814 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.877027 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.877209 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.877425 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.877614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.877767 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.877919 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.878056 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.878197 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.878348 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.878505 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.878652 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.878791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.878935 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.879115 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.879261 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.879407 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.879550 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.879687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.879832 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.879978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.880141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.880294 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.880429 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.880586 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.880951 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.881123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.881215 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.881297 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.881446 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.881584 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.881804 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.881943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.882137 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.882287 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.882447 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.882594 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.882755 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.882908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.883104 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.883239 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.883384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.883518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.883665 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.883814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.883998 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.884137 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.884293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.884438 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.884605 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.884757 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.884895 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.885031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.885200 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.885343 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.885484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.885633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.885795 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.885938 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.886098 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.886246 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.886434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.886564 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.886698 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.886851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.887019 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.887110 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.887335 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.887560 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.887673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.887874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.888008 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.888184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.888312 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.888505 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.888633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.888824 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.888925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.889136 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.889239 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.889445 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.889535 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.889763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.889854 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.890063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.890157 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.890362 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.890478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.890672 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.890802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.890996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.891109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.891299 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.891391 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.891598 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.891692 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.891904 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.892007 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.892206 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.892300 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.892507 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.892600 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.892813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.892905 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.893109 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.893209 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.893430 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.893530 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.893730 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.893831 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.894028 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.894120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.894324 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.894430 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.894627 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.894719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.894924 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.895063 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.895255 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.895362 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.895552 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.895645 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.895848 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.895947 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.896155 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.896256 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.896560 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.896700 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.896888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.897004 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.897303 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.897405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.897499 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.897584 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.897791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.897900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.898095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.898189 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.898443 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.898539 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.898753 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.898845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.899121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.899219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.899427 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.899528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.899739 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.899839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.900046 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.900147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.900365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.900464 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.900671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.900844 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.900975 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.901068 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.901298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.901388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.901614 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.901718 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.901932 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.902145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.902247 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.902474 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.902576 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.902789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.902883 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.903143 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.903237 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.903470 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.903578 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.903772 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.903874 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.904073 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.904173 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.904373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.904644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.904737 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.904983 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.905075 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.905286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.905377 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.905588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.905695 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.905896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.905996 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.906200 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.906293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.906503 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.906604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.906805 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.906897 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.907142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.907251 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.907456 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.907549 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.907769 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.907874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.908074 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.908176 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.908376 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.908469 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.908680 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.908773 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.908987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.909089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.909330 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.909430 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.909647 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.909748 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.909958 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.910058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.910267 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.910367 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.910575 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.910666 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.910877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.911021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.911209 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.911312 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.911511 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.911614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.911812 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.911904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.912166 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.912387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.912497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.912588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.912810 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.912932 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.913127 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.913228 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.913443 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.913641 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.913758 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.913945 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.914071 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.914260 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.914386 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.914578 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.914703 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.914881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.915055 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.915240 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.915393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.915561 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.915699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.915864 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.916018 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.916178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.916335 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.916481 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.916652 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.916804 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.917138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.917242 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.917536 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.917651 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.917777 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.917895 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.918177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.918300 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.918389 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.918482 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.918663 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.918819 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.918985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.919099 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.919297 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.919389 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.919601 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.919693 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.919901 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.920003 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.920199 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.920292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.920501 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.920595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.920798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.920899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.921097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.921190 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.921395 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.921803 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.922011 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.922105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.922314 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.922416 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.922610 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.922702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.922908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.923204 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.923297 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.923534 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.923627 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.923833 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.923938 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.924129 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.924229 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.924432 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.924532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.924730 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.924830 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.925028 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.925120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.925325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.925417 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.925622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.925716 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.925918 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.926011 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.926245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.926336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.926565 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.926656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.926873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.927008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.927203 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.927347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.927513 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.927644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.927849 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.928163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.928353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.928460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.928634 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.928752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.928946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.929070 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.929275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.929376 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.929585 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.929685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.929892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.929985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.930196 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.930363 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.930508 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.930609 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.930814 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.930912 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.931158 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.931269 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.931468 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.931560 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.931773 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.931865 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.932088 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.932188 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.932393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.932493 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.932702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.932846 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.933008 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.933109 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.933321 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.933412 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.933627 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.933754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.933937 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.934058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.934245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.934363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.934573 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.934691 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.934879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.935031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.935205 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.935322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.935515 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.935646 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.935822 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.935939 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.936129 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.936248 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.936442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.936573 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.936752 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.936868 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.937072 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.937198 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.937392 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.937518 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.937697 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.937936 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.938087 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.938341 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.938576 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.938708 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.938807 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.938924 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.939121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.939282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.939390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.939594 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.939686 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.939906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.940007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.940216 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.940316 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.940519 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.940618 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.940759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:14:14.940852 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.941141 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.941453 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.941766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.942078 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.942388 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.942699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.943040 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.943411 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.943781 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.944097 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.944409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.944720 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.945036 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.945388 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.945710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.946027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.946346 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.946664 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.947002 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.947320 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.947634 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.947962 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.948381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.948679 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.948907 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.949221 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.949659 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.949973 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.950348 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.950618 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.950928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.951275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.951600 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.951911 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.952234 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.952549 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.952879 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.953222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.953556 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.953886 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.954196 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.954505 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.954812 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.955148 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.955472 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.955784 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.956090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.956393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.956706 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.957012 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.957401 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.957712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.958021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.958331 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.958638 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.959120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.959484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.960000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.960137 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.960416 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.960734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.961044 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.961355 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.961662 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.961970 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.962275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.962626 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.962983 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.963301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.963630 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.963946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.964275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.964587 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.964913 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.965238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.965561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.965875 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.966211 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.966525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.966839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.967187 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.967503 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.967817 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.968130 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.968468 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.968801 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.969117 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.969470 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.969768 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.970092 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.970412 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.970724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.971082 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.971398 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.971712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.972030 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.972343 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.972657 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.972975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.973293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.973624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.973951 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.974278 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.974715 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.975308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.975682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.976000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.976352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.976689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.977010 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.977325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.977632 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:14:14.977881 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:14:15.092754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO dbcounter [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Registered counter for database nova_api Jul 12 13:14:15.113043 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_db.sqlalchemy.engines [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:14:15.120260 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writer thread running {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:14:15.130161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO dbcounter [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Registered counter for database nova_api Jul 12 13:14:15.150551 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:14:15.157972 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writer thread running {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:14:15.175596 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.context [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),819583d6-75cf-414a-9fda-c907d3b6b6d5(cell1) {{(pid=117963) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:14:15.179548 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:14:15.181095 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:14:15.181894 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:14:15.183883 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:14:15.185859 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO dbcounter [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Registered counter for database nova_cell0 Jul 12 13:14:15.189836 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO dbcounter [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Registered counter for database nova_cell1 Jul 12 13:14:15.197357 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_db.sqlalchemy.engines [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:14:15.198843 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_db.sqlalchemy.engines [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:14:15.205529 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writer thread running {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:14:15.207263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writer thread running {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:14:15.214009 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.context [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),819583d6-75cf-414a-9fda-c907d3b6b6d5(cell1) {{(pid=117962) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:14:15.217977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:14:15.219608 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:14:15.220411 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:14:15.222407 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:14:15.224453 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO dbcounter [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Registered counter for database nova_cell0 Jul 12 13:14:15.228616 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO dbcounter [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Registered counter for database nova_cell1 Jul 12 13:14:15.236002 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:14:15.238393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:14:15.245773 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writer thread running {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:14:15.247056 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writer thread running {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:14:15.350769 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO dbcounter [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Registered counter for database nova_cell0 Jul 12 13:14:15.357840 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_db.sqlalchemy.engines [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:14:15.362411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writer thread running {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:14:15.389465 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO dbcounter [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Registered counter for database nova_cell0 Jul 12 13:14:15.396525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:14:15.401528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writer thread running {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:14:15.674920 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: WARNING keystonemiddleware.auth_token [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:14:15.682353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: WARNING keystonemiddleware.auth_token [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:14:15.724129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: WARNING keystonemiddleware.auth_token [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:14:15.732237 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: WARNING keystonemiddleware.auth_token [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:14:16.021295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: WARNING keystonemiddleware.auth_token [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:14:16.027435 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: WARNING keystonemiddleware.auth_token [None req-8bbcb903-41b4-4c2a-8b79-fa16dab5a0ef None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:14:16.032744 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568fd5b59c0 pid: 117963 (default app) Jul 12 13:14:16.081282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: WARNING keystonemiddleware.auth_token [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:14:16.087585 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: WARNING keystonemiddleware.auth_token [None req-aa9d619e-b6d9-4234-90e8-1a9760a0f4f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:14:16.093148 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568fd5b59c0 pid: 117962 (default app) Jul 12 13:14:57.620114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:14:57.621429 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:14:57.622404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:14:57.623325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:14:58.044910 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:14:58.046268 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:14:58.047114 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:14:58.047839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:14:59.373362 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-db8e8206-5007-4e52-a7da-19f2491f3d6e tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Action: 'create', calling method: .version_select at 0x7fd48f02d5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2091278862", "metadata": {"Type": "work"}}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-db8e8206-5007-4e52-a7da-19f2491f3d6e tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Request method failure captured: Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 122 Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPRUvf5UekmFNJ9LiLY0wwL5_3chG-R6VzODaRdm7Faq-gfA4V9caLnOltygtYcjyX-smW7ukR-vhZBqY8-rsKgl2IneU-ptRCy_t7f_tKghEc8j_SxLbGHhQseUBiY7jH1k9DxfNvrceA_UpQbAqAPBAaj2RHBP2s03uUJJaSyzek Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:14:59.391722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesNegativeTest-232853711-project Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 9d1aea533fe049f0b29263850922b986 Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesNegativeTest-232853711-project Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2091278862", "metadata": {"Type": "work"}}} Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: Jul 12 13:14:59.393419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2091278862', 'metadata': {'Type': 'work'}}}} Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise error Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:14:59.394671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 13:14:59.396457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 13:14:59.397796 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 13:14:59.397796 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.399840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-db8e8206-5007-4e52-a7da-19f2491f3d6e tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:14:59.401567 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-db8e8206-5007-4e52-a7da-19f2491f3d6e tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.362077 Jul 12 13:14:59.407422 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Jul 12 13:14:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1370 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 13:14:59.412677 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cb96fb98-2116-4904-91b8-57feeaee7967 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Action: 'create', calling method: .version_select at 0x7fd48efa6940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1615374801", "metadata": {"Type": "work"}}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cb96fb98-2116-4904-91b8-57feeaee7967 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Request method failure captured: Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 120 Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPRUvf5UekmFNJ9LiLY0wwL5_3chG-R6VzODaRdm7Faq-gfA4V9caLnOltygtYcjyX-smW7ukR-vhZBqY8-rsKgl2IneU-ptRCy_t7f_tKghEc8j_SxLbGHhQseUBiY7jH1k9DxfNvrceA_UpQbAqAPBAaj2RHBP2s03uUJJaSyzek Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:14:59.420337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesNegativeTest-232853711-project Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 9d1aea533fe049f0b29263850922b986 Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesNegativeTest-232853711-project Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1615374801", "metadata": {"Type": "work"}}} Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: Jul 12 13:14:59.421724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1615374801', 'metadata': {'Type': 'work'}}}} Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise error Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi '0' Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:14:59.422595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 13:14:59.425485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 13:14:59.427598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 13:14:59.427598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.427598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cb96fb98-2116-4904-91b8-57feeaee7967 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:14:59.427598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cb96fb98-2116-4904-91b8-57feeaee7967 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013327 Jul 12 13:14:59.428372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6ab81bcd-4317-453c-b16c-343ff4b1b513 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] Action: 'create', calling method: .version_select at 0x7fd48f02e5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1122258045", "metadata": {"Type": "work"}}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:14:59.429580 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Jul 12 13:14:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:14:59.436124 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c1f9e77b-78ef-4295-892c-bbd1703547c0 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Action: 'create', calling method: .version_select at 0x7fd48f02d940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1232952213", "metadata": {"Type": "work"}}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c1f9e77b-78ef-4295-892c-bbd1703547c0 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Request method failure captured: Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 119 Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPRUvf5UekmFNJ9LiLY0wwL5_3chG-R6VzODaRdm7Faq-gfA4V9caLnOltygtYcjyX-smW7ukR-vhZBqY8-rsKgl2IneU-ptRCy_t7f_tKghEc8j_SxLbGHhQseUBiY7jH1k9DxfNvrceA_UpQbAqAPBAaj2RHBP2s03uUJJaSyzek Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:14:59.438520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesNegativeTest-232853711-project Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 9d1aea533fe049f0b29263850922b986 Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesNegativeTest-232853711-project Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1232952213", "metadata": {"Type": "work"}}} Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: Jul 12 13:14:59.439871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1232952213', 'metadata': {'Type': 'work'}}}} Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise error Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi '' Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:14:59.440687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 13:14:59.443147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 13:14:59.446134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 13:14:59.446134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.446134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c1f9e77b-78ef-4295-892c-bbd1703547c0 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:14:59.456005 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c1f9e77b-78ef-4295-892c-bbd1703547c0 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025245 Jul 12 13:14:59.456910 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 3/3] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Jul 12 13:14:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:14:59.468117 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-12cfe944-7926-495f-b484-8b18f461a3fb tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Calling method '.version_select at 0x7fd48ef58670>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:14:59.900700 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-12cfe944-7926-495f-b484-8b18f461a3fb tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] HTTP exception thrown: Volume tempest-invalid-1047294242 could not be found. Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-12cfe944-7926-495f-b484-8b18f461a3fb tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Request method failure captured: Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1047294242 HTTP/1.1 Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPRUvf5UekmFNJ9LiLY0wwL5_3chG-R6VzODaRdm7Faq-gfA4V9caLnOltygtYcjyX-smW7ukR-vhZBqY8-rsKgl2IneU-ptRCy_t7f_tKghEc8j_SxLbGHhQseUBiY7jH1k9DxfNvrceA_UpQbAqAPBAaj2RHBP2s03uUJJaSyzek Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:14:59.905441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesNegativeTest-232853711-project Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 9d1aea533fe049f0b29263850922b986 Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesNegativeTest-232853711-project Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Volume tempest-invalid-1047294242 could not be found. Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': 'tempest-invalid-1047294242'} Jul 12 13:14:59.907121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1047294242 could not be found. (HTTP 404) (Request-ID: req-a70f5789-5957-4988-8e51-1b22d0c8da7f) Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:14:59.908233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:14:59.909876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1047294242 could not be found. Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:14:59.911156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1047294242 could not be found. Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1047294242 could not be found. Jul 12 13:14:59.912596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:14:59.916873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-12cfe944-7926-495f-b484-8b18f461a3fb tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Returning 404 to user: Volume tempest-invalid-1047294242 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:14:59.918666 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-12cfe944-7926-495f-b484-8b18f461a3fb tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1047294242" status: 404 len: 99 microversion: 2.1 time: 0.455231 Jul 12 13:14:59.919433 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 4/4] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 12 13:14:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1047294242 => generated 99 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 13:14:59.940622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ab3ba253-fcd2-420c-a09e-fcaeb02e09ae tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015358 Jul 12 13:14:59.941740 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 5/5] 10.222.0.33 () {58 vars in 1139 bytes} [Tue Jul 12 13:14:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 13:14:59.954438 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6c9c0794-a771-4cec-a748-f4bb33b79f17 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007577 Jul 12 13:14:59.957258 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 6/6] 10.222.0.33 () {58 vars in 1136 bytes} [Tue Jul 12 13:14:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 12 13:14:59.970040 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f9f15420-9a93-47e8-9c38-a064e8e330de tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Calling method '.version_select at 0x7fd48ee84940>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:00.032240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-f9f15420-9a93-47e8-9c38-a064e8e330de tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] HTTP exception thrown: Volume 37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d could not be found. Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f9f15420-9a93-47e8-9c38-a064e8e330de tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Request method failure captured: Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: DELETE /compute/v2.1/os-volumes/37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d HTTP/1.1 Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPRUvf5UekmFNJ9LiLY0wwL5_3chG-R6VzODaRdm7Faq-gfA4V9caLnOltygtYcjyX-smW7ukR-vhZBqY8-rsKgl2IneU-ptRCy_t7f_tKghEc8j_SxLbGHhQseUBiY7jH1k9DxfNvrceA_UpQbAqAPBAaj2RHBP2s03uUJJaSyzek Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:15:00.034670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesNegativeTest-232853711 Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesNegativeTest-232853711-project Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 9d1aea533fe049f0b29263850922b986 Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesNegativeTest-232853711-project Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Volume 37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d could not be found. Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d'} Jul 12 13:15:00.036249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d could not be found. (HTTP 404) (Request-ID: req-a8b4ecab-dd2e-43ed-b72f-a7d4644df5bf) Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:15:00.037219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:15:00.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d could not be found. Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 13:15:00.039892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d could not be found. Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d could not be found. Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f9f15420-9a93-47e8-9c38-a064e8e330de tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Returning 404 to user: Volume 37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f9f15420-9a93-47e8-9c38-a064e8e330de tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d" status: 404 len: 109 microversion: 2.1 time: 0.074105 Jul 12 13:15:00.041027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 7/7] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:14:59 2022] DELETE /compute/v2.1/os-volumes/37fa32a1-0eba-4d9a-bffe-e21c3ba4c96d => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:15:00.046840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5df2ff04-5fde-43bf-806a-1ebe73029714 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Calling method '.version_select at 0x7fd48ee843a0>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:00.217212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-5df2ff04-5fde-43bf-806a-1ebe73029714 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] HTTP exception thrown: Volume d17a881a-0484-4f52-8e66-9101899c2e2f could not be found. Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5df2ff04-5fde-43bf-806a-1ebe73029714 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Request method failure captured: Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/os-volumes/d17a881a-0484-4f52-8e66-9101899c2e2f HTTP/1.1 Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPRUvf5UekmFNJ9LiLY0wwL5_3chG-R6VzODaRdm7Faq-gfA4V9caLnOltygtYcjyX-smW7ukR-vhZBqY8-rsKgl2IneU-ptRCy_t7f_tKghEc8j_SxLbGHhQseUBiY7jH1k9DxfNvrceA_UpQbAqAPBAaj2RHBP2s03uUJJaSyzek Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:15:00.220557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9b434f87a7584460ac3b7ae7035911ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesNegativeTest-232853711 Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 9b434f87a7584460ac3b7ae7035911ec Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesNegativeTest-232853711 Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesNegativeTest-232853711-project Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 9d1aea533fe049f0b29263850922b986 Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesNegativeTest-232853711-project Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Volume d17a881a-0484-4f52-8e66-9101899c2e2f could not be found. Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': 'd17a881a-0484-4f52-8e66-9101899c2e2f'} Jul 12 13:15:00.222149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d17a881a-0484-4f52-8e66-9101899c2e2f could not be found. (HTTP 404) (Request-ID: req-da528b88-0ae7-4494-b901-48841ea219b9) Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:15:00.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:15:00.224669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d17a881a-0484-4f52-8e66-9101899c2e2f could not be found. Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:15:00.225833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d17a881a-0484-4f52-8e66-9101899c2e2f could not be found. Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d17a881a-0484-4f52-8e66-9101899c2e2f could not be found. Jul 12 13:15:00.227028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:15:00.229290 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5df2ff04-5fde-43bf-806a-1ebe73029714 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] Returning 404 to user: Volume d17a881a-0484-4f52-8e66-9101899c2e2f could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:15:00.230870 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5df2ff04-5fde-43bf-806a-1ebe73029714 tempest-VolumesNegativeTest-232853711 tempest-VolumesNegativeTest-232853711-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d17a881a-0484-4f52-8e66-9101899c2e2f" status: 404 len: 109 microversion: 2.1 time: 0.188878 Jul 12 13:15:00.231906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 8/8] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:15:00 2022] GET /compute/v2.1/os-volumes/d17a881a-0484-4f52-8e66-9101899c2e2f => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:15:00.839075 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6ab81bcd-4317-453c-b16c-343ff4b1b513 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.229006 Jul 12 13:15:00.853373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 1/9] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Jul 12 13:14:57 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3245 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 13:15:00.859384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f2ebfde1-b70e-4b0d-bab1-32943befef1c tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] Calling method '.version_select at 0x7fd48ee84c10>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:01.047381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f2ebfde1-b70e-4b0d-bab1-32943befef1c tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1" status: 200 len: 353 microversion: 2.1 time: 0.198154 Jul 12 13:15:01.053514 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 9/10] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:15:00 2022] GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 => generated 353 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:02.062231 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-17a66e83-bf27-4e15-af38-0c97a1cc58ac tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] Calling method '.version_select at 0x7fd48eef44c0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:02.177702 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-17a66e83-bf27-4e15-af38-0c97a1cc58ac tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1" status: 200 len: 354 microversion: 2.1 time: 0.120497 Jul 12 13:15:02.182268 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 2/11] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:15:02 2022] GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:15:02.189936 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ad85cef6-6e15-495d-9be4-d5b089a2ba9d tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] Calling method '.version_select at 0x7fd48ee84040>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:02.256230 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ad85cef6-6e15-495d-9be4-d5b089a2ba9d tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1" status: 200 len: 354 microversion: 2.1 time: 0.069911 Jul 12 13:15:02.256750 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 10/12] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:15:02 2022] GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:02.278245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fd529bd4-bc97-40b9-84db-6810549aed34 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] Calling method '.version_select at 0x7fd48eef45e0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:02.384156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fd529bd4-bc97-40b9-84db-6810549aed34 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1" status: 202 len: 0 microversion: 2.1 time: 0.109800 Jul 12 13:15:02.384723 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 3/13] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:15:02 2022] DELETE /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:15:02.392552 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-006ba663-10c5-4c83-b43a-37c83675ae49 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] Calling method '.version_select at 0x7fd48ef58670>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:02.498539 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-006ba663-10c5-4c83-b43a-37c83675ae49 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1" status: 200 len: 353 microversion: 2.1 time: 0.109744 Jul 12 13:15:02.499421 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 11/14] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:15:02 2022] GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:15:03.511495 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1b87a086-36ca-446a-8fa8-9bcaa8c0e409 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] Calling method '.version_select at 0x7fd48eef4c10>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:03.607318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-1b87a086-36ca-446a-8fa8-9bcaa8c0e409 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] HTTP exception thrown: Volume c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 could not be found. Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1b87a086-36ca-446a-8fa8-9bcaa8c0e409 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] Request method failure captured: Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 HTTP/1.1 Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPRxmC1mIX20OEAqTCC0yhdHmmpwsnTQTo0YSXb2sOEI-ypWLG4FNLmBaCT7UFRMtgySKpNJGAGWkK0RiHcKcEI3bUo469KthP300EQZl_hsn8uytgObskdlXOWl7QRSYKbtPcGDMq3hb95cxnjjrMfRkUm7ChSwai9zu6ZBUXzKLI Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: 394775cc657e404eacea4df6ac7ff275 Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesGetTestJSON-1279518118 Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:15:03.612163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/394775cc657e404eacea4df6ac7ff275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_394775cc657e404eacea4df6ac7ff275"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/394775cc657e404eacea4df6ac7ff275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/394775cc657e404eacea4df6ac7ff275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesGetTestJSON-1279518118 Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 394775cc657e404eacea4df6ac7ff275 Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesGetTestJSON-1279518118 Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesGetTestJSON-1279518118-project Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 16343ab6dc6b4e8eb20301987348ec40 Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesGetTestJSON-1279518118-project Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Volume c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 could not be found. Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': 'c17c0bdb-4ff1-492c-aba8-f1b29c515ba1'} Jul 12 13:15:03.613528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 could not be found. (HTTP 404) (Request-ID: req-1d3d3cee-bfee-4024-b757-cea82faf10b1) Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:15:03.614223 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:15:03.619040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 could not be found. Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:15:03.620885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 could not be found. Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 could not be found. Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1b87a086-36ca-446a-8fa8-9bcaa8c0e409 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] Returning 404 to user: Volume c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1b87a086-36ca-446a-8fa8-9bcaa8c0e409 tempest-VolumesGetTestJSON-1279518118 tempest-VolumesGetTestJSON-1279518118-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1" status: 404 len: 109 microversion: 2.1 time: 0.106152 Jul 12 13:15:03.624177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 4/15] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:15:03 2022] GET /compute/v2.1/os-volumes/c17c0bdb-4ff1-492c-aba8-f1b29c515ba1 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:15:12.879340 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-134240621", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:13.239921 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] validate_networks() for [('ca5e922c-b92d-4e11-a28c-945e9c62e240', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:15:16.475904 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-26d800b0-d216-4e65-af0e-ca8d27e84703 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'create', calling method: .version_select at 0x7fd48ef0fca0>, body: {"keypair": {"name": "tempest-keypair-30183758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUt6zAyQY5iBgRCEwmmKU1PjM4z70r/SF44OpbHGezSfLW29bod74qWv3IbMfXB7BcWiire3NF8brYn+d0p92Wj2WGy45HiuOCCzYfsJAk0B0BM8HoU+K6UokXp4jYlQw=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:16.580586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-26d800b0-d216-4e65-af0e-ca8d27e84703 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Getting quotas for project 69fbc5a39eab44419423278adc1cf201. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:15:16.590339 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-26d800b0-d216-4e65-af0e-ca8d27e84703 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Getting quotas for user 0b4bdaf5c1964d629cd417e41ff8a21c and project 69fbc5a39eab44419423278adc1cf201. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:15:16.674825 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-26d800b0-d216-4e65-af0e-ca8d27e84703 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.389631 Jul 12 13:15:16.676245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 5/16] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 12 13:15:16 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 392 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 12 13:15:16.786342 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3fb609bb-66e7-49e4-9139-132ac1c6fc50 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: .version_select at 0x7fd48ee443a0>, body: {"keypair": {"name": "tempest-keypair-1752439818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtrBtQCEPExx6Z5oRONTxy1ZuHWaAqLqJfnOdptd+0EKgknPO6pGJBAGXRx8oDcxfNaaRRALZZ2iG5pDhn3BXEVbuEFLULeH/ZUxT/7JroJqJW6XVN/nVuJNQfUraQdKA=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:16.819585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-3fb609bb-66e7-49e4-9139-132ac1c6fc50 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:15:16.830504 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-3fb609bb-66e7-49e4-9139-132ac1c6fc50 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for user c8380cfce8114b609c8f0cbf9d445049 and project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:15:16.845502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:15:16.847469 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:15:16.848452 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:15:16.849032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:15:16.849584 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:15:16.895885 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:16.899872 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:16.900297 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3fb609bb-66e7-49e4-9139-132ac1c6fc50 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.221821 Jul 12 13:15:16.903669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:16.905086 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:16.915326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 6/17] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:15:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:16.983653 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Getting quotas for project d175790280c1443192810e2b789b9926. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:15:17.007100 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Getting quotas for user 9e08af1e7f794f85b57d6912db529577 and project d175790280c1443192810e2b789b9926. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:15:17.025762 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:15:17.029174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:15:17.054070 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1437637617", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "networks": [{"uuid": "9603b320-afc2-486f-964d-5592d3de0894"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:17.256215 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] validate_networks() for [('9603b320-afc2-486f-964d-5592d3de0894', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:15:17.320470 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4ecad7a3-87ed-4c94-b0f0-83fabd3e2bae tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.427572 Jul 12 13:15:17.332733 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 12/18] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:15:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 5441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:15:17.344295 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6e113c99-5dbd-458a-a96d-7833a871eb82 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:17.345827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6e113c99-5dbd-458a-a96d-7833a871eb82 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:17.587135 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6e113c99-5dbd-458a-a96d-7833a871eb82 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:17.635463 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6e113c99-5dbd-458a-a96d-7833a871eb82 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1221 microversion: 2.1 time: 0.301075 Jul 12 13:15:17.646633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 13/19] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:17 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1221 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:17.857303 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-80870704", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:17.968258 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] validate_networks() for [('ca5e922c-b92d-4e11-a28c-945e9c62e240', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:15:19.296857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:15:19.297378 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:15:19.297836 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:15:19.298575 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:15:19.299060 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:15:19.341288 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:19.342016 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:19.344917 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:19.346192 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:19.415008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Getting quotas for project ad474240c3a746d78ea5289f09ca4d97. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:15:19.428255 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Getting quotas for user 34699f2119154c5f87c115490317eaf3 and project ad474240c3a746d78ea5289f09ca4d97. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:15:19.459790 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:15:19.464983 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:15:19.609488 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4c94a2bd-4052-4225-812f-dcc31e154575 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.692295 Jul 12 13:15:19.611776 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 7/20] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:15:19.627499 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ed6940e7-4454-466b-a25d-55c26e544d87 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:19.628118 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ed6940e7-4454-466b-a25d-55c26e544d87 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:19.763422 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:15:19.764371 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:15:19.764991 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:15:19.765540 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:15:19.766089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:15:19.787562 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:19.788711 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:19.789519 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:19.789950 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:19.849516 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ed6940e7-4454-466b-a25d-55c26e544d87 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:19.853224 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Getting quotas for project d175790280c1443192810e2b789b9926. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:15:19.858678 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Getting quotas for user 9e08af1e7f794f85b57d6912db529577 and project d175790280c1443192810e2b789b9926. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:15:19.871954 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:15:19.874453 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:15:19.918290 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ed6940e7-4454-466b-a25d-55c26e544d87 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1215 microversion: 2.1 time: 0.298462 Jul 12 13:15:19.923582 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 8/21] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:19 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:19.972496 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-540c627f-e5ae-415f-a369-61c5bdc9d3c0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.117983 Jul 12 13:15:19.973495 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 14/22] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:15:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 13:15:19.984669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0f10e170-4997-41c7-b88c-8c4cfad7529e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:19.985501 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0f10e170-4997-41c7-b88c-8c4cfad7529e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:20.174487 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0f10e170-4997-41c7-b88c-8c4cfad7529e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:20.186354 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0f10e170-4997-41c7-b88c-8c4cfad7529e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1220 microversion: 2.1 time: 0.205846 Jul 12 13:15:20.188824 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 9/23] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:19 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:20.940680 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3e31abef-b021-4e88-8dbb-0616b9ad9f84 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:20.941757 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3e31abef-b021-4e88-8dbb-0616b9ad9f84 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:21.083029 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3e31abef-b021-4e88-8dbb-0616b9ad9f84 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:21.090555 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3e31abef-b021-4e88-8dbb-0616b9ad9f84 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1215 microversion: 2.1 time: 0.154012 Jul 12 13:15:21.094719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 15/24] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:20 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:21.205283 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ff0afc8b-2cdf-4752-adf8-c20774652872 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:21.206088 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ff0afc8b-2cdf-4752-adf8-c20774652872 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:21.219236 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff0afc8b-2cdf-4752-adf8-c20774652872 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:21.223129 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff0afc8b-2cdf-4752-adf8-c20774652872 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:21.224399 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff0afc8b-2cdf-4752-adf8-c20774652872 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:21.229233 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff0afc8b-2cdf-4752-adf8-c20774652872 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:21.871546 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ff0afc8b-2cdf-4752-adf8-c20774652872 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:21.914128 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ff0afc8b-2cdf-4752-adf8-c20774652872 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1216 microversion: 2.1 time: 0.710503 Jul 12 13:15:21.916748 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 10/25] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:21 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1216 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:22.109093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7eb1e5ca-7b3a-4986-bef8-adddf1bbbb95 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:22.109655 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7eb1e5ca-7b3a-4986-bef8-adddf1bbbb95 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:22.138572 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7eb1e5ca-7b3a-4986-bef8-adddf1bbbb95 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:22.138997 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7eb1e5ca-7b3a-4986-bef8-adddf1bbbb95 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:22.139746 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7eb1e5ca-7b3a-4986-bef8-adddf1bbbb95 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:22.140224 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7eb1e5ca-7b3a-4986-bef8-adddf1bbbb95 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:22.811591 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7eb1e5ca-7b3a-4986-bef8-adddf1bbbb95 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:22.832374 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7eb1e5ca-7b3a-4986-bef8-adddf1bbbb95 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1211 microversion: 2.1 time: 0.727476 Jul 12 13:15:22.834559 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 16/26] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:22 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1211 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:22.935868 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0e16930e-f0c2-4c5c-b30f-86abeec947cd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:22.938742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0e16930e-f0c2-4c5c-b30f-86abeec947cd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:22.961024 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e16930e-f0c2-4c5c-b30f-86abeec947cd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:22.961468 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e16930e-f0c2-4c5c-b30f-86abeec947cd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:22.962237 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e16930e-f0c2-4c5c-b30f-86abeec947cd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:22.967680 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e16930e-f0c2-4c5c-b30f-86abeec947cd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:23.199638 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-412746494", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5765647a-f52d-4fde-ab6b-47dcfe530ab0"}], "security_groups": [{"name": "tempest-securitygroup--1471570184"}], "key_name": "tempest-keypair-1752439818", "user_data": "}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:23.385697 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0e16930e-f0c2-4c5c-b30f-86abeec947cd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:23.417574 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0e16930e-f0c2-4c5c-b30f-86abeec947cd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1278 microversion: 2.1 time: 0.489218 Jul 12 13:15:23.452879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 11/27] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:22 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1278 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:23.850588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-78ab06f2-fb3a-4953-a4c4-4756bbe71eb1 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:23.851334 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-78ab06f2-fb3a-4953-a4c4-4756bbe71eb1 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:23.866304 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78ab06f2-fb3a-4953-a4c4-4756bbe71eb1 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:23.877308 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78ab06f2-fb3a-4953-a4c4-4756bbe71eb1 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:23.878116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78ab06f2-fb3a-4953-a4c4-4756bbe71eb1 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:23.880270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78ab06f2-fb3a-4953-a4c4-4756bbe71eb1 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:24.183379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-78ab06f2-fb3a-4953-a4c4-4756bbe71eb1 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:24.199413 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-78ab06f2-fb3a-4953-a4c4-4756bbe71eb1 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1273 microversion: 2.1 time: 0.347321 Jul 12 13:15:24.200457 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 12/28] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:23 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1273 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:24.458754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-40b2ba5e-4734-49d7-b483-fe2bf86f6f1b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:24.459737 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-40b2ba5e-4734-49d7-b483-fe2bf86f6f1b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:24.473814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40b2ba5e-4734-49d7-b483-fe2bf86f6f1b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:24.475908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40b2ba5e-4734-49d7-b483-fe2bf86f6f1b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:24.477247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40b2ba5e-4734-49d7-b483-fe2bf86f6f1b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:24.486112 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-40b2ba5e-4734-49d7-b483-fe2bf86f6f1b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:24.554496 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] validate_networks() for [('5765647a-f52d-4fde-ab6b-47dcfe530ab0', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:15:24.752491 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-40b2ba5e-4734-49d7-b483-fe2bf86f6f1b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:24.767719 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-40b2ba5e-4734-49d7-b483-fe2bf86f6f1b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1278 microversion: 2.1 time: 0.308520 Jul 12 13:15:24.778857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 13/29] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:24 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1278 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:25.218023 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0bd343b6-b2d0-4448-a712-945a8ea3301f tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:25.220066 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0bd343b6-b2d0-4448-a712-945a8ea3301f tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:25.236666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bd343b6-b2d0-4448-a712-945a8ea3301f tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:25.238768 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bd343b6-b2d0-4448-a712-945a8ea3301f tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:25.243527 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bd343b6-b2d0-4448-a712-945a8ea3301f tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:25.244211 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bd343b6-b2d0-4448-a712-945a8ea3301f tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:25.743312 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0bd343b6-b2d0-4448-a712-945a8ea3301f tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:25.755646 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0bd343b6-b2d0-4448-a712-945a8ea3301f tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1273 microversion: 2.1 time: 0.537820 Jul 12 13:15:25.759454 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 14/30] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:25 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1273 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:25.777982 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-389877702", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d117129f-a685-47e6-ac3e-cac3ff34342b"}], "security_groups": [{"name": "tempest-securitygroup--516814654"}], "key_name": "tempest-keypair-30183758", "user_data": "}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:26.316158 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] validate_networks() for [('d117129f-a685-47e6-ac3e-cac3ff34342b', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:15:28.571595 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:15:28.572365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:15:28.572533 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:15:28.573039 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:15:28.573580 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:15:28.608253 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:28.608973 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:28.613650 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:28.616015 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:28.702442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Getting quotas for project 69fbc5a39eab44419423278adc1cf201. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:15:28.719849 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Getting quotas for user 0b4bdaf5c1964d629cd417e41ff8a21c and project 69fbc5a39eab44419423278adc1cf201. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:15:28.760185 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:15:28.767232 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:15:28.894397 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:15:28.895333 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:15:28.895816 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:15:28.896224 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:15:28.896634 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:15:28.900966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-54880ba3-249a-4e1a-a7d1-d116d480bccf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.140227 Jul 12 13:15:28.909094 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 15/31] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 12 13:15:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 3144 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 13:15:28.916182 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2c207e4a-90b1-4336-9a78-5ed51779cd1f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:28.916856 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2c207e4a-90b1-4336-9a78-5ed51779cd1f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:28.933272 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c207e4a-90b1-4336-9a78-5ed51779cd1f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:28.933730 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c207e4a-90b1-4336-9a78-5ed51779cd1f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:28.936382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c207e4a-90b1-4336-9a78-5ed51779cd1f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:28.936854 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c207e4a-90b1-4336-9a78-5ed51779cd1f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:29.002097 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:29.006257 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:29.012227 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:29.012690 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:29.083808 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:15:29.103903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for user c8380cfce8114b609c8f0cbf9d445049 and project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:15:29.205069 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:15:29.208473 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:15:29.222604 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2c207e4a-90b1-4336-9a78-5ed51779cd1f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:29.235661 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2c207e4a-90b1-4336-9a78-5ed51779cd1f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1278 microversion: 2.1 time: 0.329957 Jul 12 13:15:29.237536 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 16/32] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:28 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1278 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:29.252458 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0685af60-e114-478c-a84c-f5947abbc300 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:29.253618 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0685af60-e114-478c-a84c-f5947abbc300 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:29.271990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0685af60-e114-478c-a84c-f5947abbc300 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:29.273091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0685af60-e114-478c-a84c-f5947abbc300 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:29.276581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0685af60-e114-478c-a84c-f5947abbc300 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:29.277063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0685af60-e114-478c-a84c-f5947abbc300 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:29.421956 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-33baac73-7cf8-4cd5-af43-f843b2031c97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.227239 Jul 12 13:15:29.448148 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 17/33] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:15:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 6254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:15:29.467458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-58b3d31d-de93-4a05-8401-800f2ded40a3 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:29.468809 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-58b3d31d-de93-4a05-8401-800f2ded40a3 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:29.910584 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-58b3d31d-de93-4a05-8401-800f2ded40a3 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:29.934741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-58b3d31d-de93-4a05-8401-800f2ded40a3 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:29.942149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-58b3d31d-de93-4a05-8401-800f2ded40a3 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:29.944154 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-58b3d31d-de93-4a05-8401-800f2ded40a3 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1279 microversion: 2.20 time: 0.488369 Jul 12 13:15:29.948396 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 18/34] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:29 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1279 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:29.970756 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cb0cbfb8-a2e0-463d-b219-eac1fd55e4f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:29.978514 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cb0cbfb8-a2e0-463d-b219-eac1fd55e4f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:30.463297 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0685af60-e114-478c-a84c-f5947abbc300 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:30.484376 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0685af60-e114-478c-a84c-f5947abbc300 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 1.244790 Jul 12 13:15:30.484994 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 17/35] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:29 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:30.502834 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-68f59246-bb25-455b-8cf3-fec1ae151f4a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:30.503498 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-68f59246-bb25-455b-8cf3-fec1ae151f4a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:30.511816 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-cb0cbfb8-a2e0-463d-b219-eac1fd55e4f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:30.518732 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cb0cbfb8-a2e0-463d-b219-eac1fd55e4f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1241 microversion: 2.1 time: 0.564533 Jul 12 13:15:30.519356 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 19/36] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:29 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1241 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:30.532461 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-68f59246-bb25-455b-8cf3-fec1ae151f4a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:30.535338 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-68f59246-bb25-455b-8cf3-fec1ae151f4a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:30.536414 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-68f59246-bb25-455b-8cf3-fec1ae151f4a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:30.539411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-68f59246-bb25-455b-8cf3-fec1ae151f4a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:30.856208 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-68f59246-bb25-455b-8cf3-fec1ae151f4a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:30.890899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-68f59246-bb25-455b-8cf3-fec1ae151f4a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.392276 Jul 12 13:15:30.893212 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 18/37] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:30 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:30.966392 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:30.967685 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:30.989251 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:30.990020 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:30.992904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:30.995335 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:31.222886 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:31.234924 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:31.237579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:31.239995 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2683c5a6-83ab-459c-bdc3-fe4f75e59089 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1283 microversion: 2.20 time: 0.277242 Jul 12 13:15:31.240767 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 20/38] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:30 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1283 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:31.501551 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-18a4293c-79c5-4f8d-a57e-cb8df148c896 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:31.502466 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-18a4293c-79c5-4f8d-a57e-cb8df148c896 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:31.528543 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18a4293c-79c5-4f8d-a57e-cb8df148c896 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:31.529052 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18a4293c-79c5-4f8d-a57e-cb8df148c896 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:31.530188 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18a4293c-79c5-4f8d-a57e-cb8df148c896 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:31.530304 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18a4293c-79c5-4f8d-a57e-cb8df148c896 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:31.538323 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c0a67344-66af-4805-8562-0f139c671ea1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:31.538865 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c0a67344-66af-4805-8562-0f139c671ea1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:31.551198 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0a67344-66af-4805-8562-0f139c671ea1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:31.551652 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0a67344-66af-4805-8562-0f139c671ea1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:31.552427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0a67344-66af-4805-8562-0f139c671ea1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:31.552854 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0a67344-66af-4805-8562-0f139c671ea1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:31.681923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c0a67344-66af-4805-8562-0f139c671ea1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:31.695106 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c0a67344-66af-4805-8562-0f139c671ea1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1245 microversion: 2.1 time: 0.160681 Jul 12 13:15:31.707779 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 21/39] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:31 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1245 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:31.887848 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-031385f0-9061-4ad0-911f-e8fe6ed175bc req-5b474357-760d-4195-bb86-8c5d0dd09a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff5b881-a7b8-4dd9-abf9-c7972b9e68ef", "tag": "35b5d0a9-e77c-4780-8109-57c6b5712d76"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:31.899725 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-031385f0-9061-4ad0-911f-e8fe6ed175bc req-5b474357-760d-4195-bb86-8c5d0dd09a62 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:31.900155 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-031385f0-9061-4ad0-911f-e8fe6ed175bc req-5b474357-760d-4195-bb86-8c5d0dd09a62 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:31.934909 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-18a4293c-79c5-4f8d-a57e-cb8df148c896 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:31.936841 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-031385f0-9061-4ad0-911f-e8fe6ed175bc req-5b474357-760d-4195-bb86-8c5d0dd09a62 service nova] Creating event network-changed:35b5d0a9-e77c-4780-8109-57c6b5712d76 for instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef on hv-cinder-79760 Jul 12 13:15:31.938116 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-031385f0-9061-4ad0-911f-e8fe6ed175bc req-5b474357-760d-4195-bb86-8c5d0dd09a62 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117962) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 13:15:31.939645 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-88845170-ad79-4515-9e53-48411ac187ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:31.940298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-88845170-ad79-4515-9e53-48411ac187ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:31.941603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-88845170-ad79-4515-9e53-48411ac187ad None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:31.942259 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-88845170-ad79-4515-9e53-48411ac187ad None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:31.942614 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-18a4293c-79c5-4f8d-a57e-cb8df148c896 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.444833 Jul 12 13:15:31.945250 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 19/40] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:31 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:31.958302 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.compute.rpcapi [None req-88845170-ad79-4515-9e53-48411ac187ad None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 13:15:31.959693 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-88845170-ad79-4515-9e53-48411ac187ad None None] Releasing lock "compute-rpcapi-router" {{(pid=117962) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 13:15:31.993086 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-88845170-ad79-4515-9e53-48411ac187ad None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230565 Jul 12 13:15:31.995875 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 22/41] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:15:32.006873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bf41f4c5-a217-4147-9675-7aca33f48ece tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:32.009292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bf41f4c5-a217-4147-9675-7aca33f48ece tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:32.072599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf41f4c5-a217-4147-9675-7aca33f48ece tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:32.073626 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf41f4c5-a217-4147-9675-7aca33f48ece tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:32.074969 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf41f4c5-a217-4147-9675-7aca33f48ece tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:32.080191 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf41f4c5-a217-4147-9675-7aca33f48ece tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:32.081476 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-f9efef1c-6db7-4c1a-ad90-7e50fc4832ee req-87364f2f-4970-442d-88c5-4bc3983f7a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185dde2b-5476-49f7-bf9d-65a6170bbbc7", "tag": "c0df3222-7842-45d4-a55f-acc681bd613c"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:32.148043 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f9efef1c-6db7-4c1a-ad90-7e50fc4832ee req-87364f2f-4970-442d-88c5-4bc3983f7a99 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:32.150468 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f9efef1c-6db7-4c1a-ad90-7e50fc4832ee req-87364f2f-4970-442d-88c5-4bc3983f7a99 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:32.235143 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-f9efef1c-6db7-4c1a-ad90-7e50fc4832ee req-87364f2f-4970-442d-88c5-4bc3983f7a99 service nova] Creating event network-changed:c0df3222-7842-45d4-a55f-acc681bd613c for instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 on hv-cinder-79760 Jul 12 13:15:32.237138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f9efef1c-6db7-4c1a-ad90-7e50fc4832ee req-87364f2f-4970-442d-88c5-4bc3983f7a99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 13:15:32.241393 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c859f69c-456f-426f-a38b-fff1028c2997 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:32.242791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c859f69c-456f-426f-a38b-fff1028c2997 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:32.244012 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c859f69c-456f-426f-a38b-fff1028c2997 None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:32.244555 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c859f69c-456f-426f-a38b-fff1028c2997 None None] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:32.276270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.compute.rpcapi [None req-c859f69c-456f-426f-a38b-fff1028c2997 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 13:15:32.281266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c859f69c-456f-426f-a38b-fff1028c2997 None None] Releasing lock "compute-rpcapi-router" {{(pid=117963) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 13:15:32.347530 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c859f69c-456f-426f-a38b-fff1028c2997 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.399880 Jul 12 13:15:32.351521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 20/42] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:32.357481 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:32.358203 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:32.383126 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:32.390059 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:32.391103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:32.391576 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:33.006668 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:33.028751 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:33.030496 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:33.040183 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f0643564-80b4-4e39-bdf1-a768068b0cf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1283 microversion: 2.20 time: 0.687342 Jul 12 13:15:33.044337 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 21/43] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:32 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1283 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:33.079357 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b68edbe5-8f73-4236-a577-52270a03538c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:33.083009 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b68edbe5-8f73-4236-a577-52270a03538c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:33.114388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b68edbe5-8f73-4236-a577-52270a03538c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:33.123616 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b68edbe5-8f73-4236-a577-52270a03538c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:33.124732 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b68edbe5-8f73-4236-a577-52270a03538c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:33.129607 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b68edbe5-8f73-4236-a577-52270a03538c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:33.447988 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b68edbe5-8f73-4236-a577-52270a03538c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:33.460107 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b68edbe5-8f73-4236-a577-52270a03538c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1237 microversion: 2.1 time: 0.409157 Jul 12 13:15:33.463810 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 22/44] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:33 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1237 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:33.474888 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5ec71ce4-dbca-4b1d-9559-1f72a00cae69 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:33.476847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5ec71ce4-dbca-4b1d-9559-1f72a00cae69 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:33.497242 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ec71ce4-dbca-4b1d-9559-1f72a00cae69 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:33.499348 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ec71ce4-dbca-4b1d-9559-1f72a00cae69 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:33.500326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ec71ce4-dbca-4b1d-9559-1f72a00cae69 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:33.502333 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5ec71ce4-dbca-4b1d-9559-1f72a00cae69 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:33.853993 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-bf41f4c5-a217-4147-9675-7aca33f48ece tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:33.864661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-bf41f4c5-a217-4147-9675-7aca33f48ece tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 1.867479 Jul 12 13:15:33.882060 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 23/45] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:31 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:34.063603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:34.066472 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:34.101824 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:34.103604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:34.108031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:34.112130 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:34.734021 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5ec71ce4-dbca-4b1d-9559-1f72a00cae69 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:34.742462 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5ec71ce4-dbca-4b1d-9559-1f72a00cae69 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 1.277372 Jul 12 13:15:34.752639 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 23/46] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:33 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:34.761148 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fe177b9f-18aa-4680-9a44-49b1cfe1dfa2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:34.776253 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fe177b9f-18aa-4680-9a44-49b1cfe1dfa2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:34.779675 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:34.788977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:34.805439 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe177b9f-18aa-4680-9a44-49b1cfe1dfa2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:34.807633 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe177b9f-18aa-4680-9a44-49b1cfe1dfa2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:34.824480 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe177b9f-18aa-4680-9a44-49b1cfe1dfa2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:34.824964 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:34.825627 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe177b9f-18aa-4680-9a44-49b1cfe1dfa2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:34.827011 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4f546e3f-4474-491e-8f42-2b38fec79206 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1331 microversion: 2.20 time: 0.768850 Jul 12 13:15:34.842409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:34 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1331 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:15:34.891855 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-29e47b1b-570b-48c2-a696-9e23587def06 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:34.893347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-29e47b1b-570b-48c2-a696-9e23587def06 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:34.905472 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29e47b1b-570b-48c2-a696-9e23587def06 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:34.906812 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29e47b1b-570b-48c2-a696-9e23587def06 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:34.908240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29e47b1b-570b-48c2-a696-9e23587def06 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:34.909071 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29e47b1b-570b-48c2-a696-9e23587def06 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:35.387450 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fe177b9f-18aa-4680-9a44-49b1cfe1dfa2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:35.421860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fe177b9f-18aa-4680-9a44-49b1cfe1dfa2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1311 microversion: 2.1 time: 0.664468 Jul 12 13:15:35.425163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 24/48] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:34 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1311 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:35.749728 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-29e47b1b-570b-48c2-a696-9e23587def06 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:35.769834 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bec2ec10-aa25-4a1e-a39a-e3c81ba693d4 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:35.770836 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bec2ec10-aa25-4a1e-a39a-e3c81ba693d4 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:35.780193 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bec2ec10-aa25-4a1e-a39a-e3c81ba693d4 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:35.782490 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-29e47b1b-570b-48c2-a696-9e23587def06 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.894457 Jul 12 13:15:35.793298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 25/49] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:34 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:35.793409 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bec2ec10-aa25-4a1e-a39a-e3c81ba693d4 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:35.793409 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bec2ec10-aa25-4a1e-a39a-e3c81ba693d4 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:35.793409 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bec2ec10-aa25-4a1e-a39a-e3c81ba693d4 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:35.849832 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:35.850566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:35.879159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:35.882818 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:35.884112 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:35.887531 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:36.150117 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:36.169384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:36.177896 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:36.180805 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0231761d-8a24-4aa4-80a3-0ee75a76c62e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1337 microversion: 2.20 time: 0.334735 Jul 12 13:15:36.184507 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:35 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1337 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:36.450378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-dc1266fb-5993-4b6f-bd42-6507cdbe6476 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:36.452348 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-dc1266fb-5993-4b6f-bd42-6507cdbe6476 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:36.478115 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dc1266fb-5993-4b6f-bd42-6507cdbe6476 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:36.480265 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dc1266fb-5993-4b6f-bd42-6507cdbe6476 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:36.483379 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dc1266fb-5993-4b6f-bd42-6507cdbe6476 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:36.484102 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dc1266fb-5993-4b6f-bd42-6507cdbe6476 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:36.660982 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-dc1266fb-5993-4b6f-bd42-6507cdbe6476 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:36.673326 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-dc1266fb-5993-4b6f-bd42-6507cdbe6476 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1299 microversion: 2.1 time: 0.233670 Jul 12 13:15:36.693669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 27/51] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:36 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1299 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:36.808404 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8a4ea5d3-f921-4b56-8157-67bc0c422ee5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:36.809424 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8a4ea5d3-f921-4b56-8157-67bc0c422ee5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:36.865384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8a4ea5d3-f921-4b56-8157-67bc0c422ee5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:36.866019 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8a4ea5d3-f921-4b56-8157-67bc0c422ee5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:36.873440 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8a4ea5d3-f921-4b56-8157-67bc0c422ee5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:36.878489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8a4ea5d3-f921-4b56-8157-67bc0c422ee5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:37.450651 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8a4ea5d3-f921-4b56-8157-67bc0c422ee5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:37.463370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8a4ea5d3-f921-4b56-8157-67bc0c422ee5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.665222 Jul 12 13:15:37.467439 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 28/52] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:36 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:37.481869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-9e344ed8-f292-4967-8673-50124ea3d077 req-9d2d2898-fa18-40ae-bb2e-f1c6a9f0453f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882374fe-d7b8-4a2b-a70c-e7d15c9138c1", "tag": "d389aa10-6727-4171-84ec-b212c85b7728"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:37.502562 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-9e344ed8-f292-4967-8673-50124ea3d077 req-9d2d2898-fa18-40ae-bb2e-f1c6a9f0453f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:37.514204 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-9e344ed8-f292-4967-8673-50124ea3d077 req-9d2d2898-fa18-40ae-bb2e-f1c6a9f0453f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:37.539785 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-9e344ed8-f292-4967-8673-50124ea3d077 req-9d2d2898-fa18-40ae-bb2e-f1c6a9f0453f service nova] Creating event network-changed:d389aa10-6727-4171-84ec-b212c85b7728 for instance 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 on hv-cinder-79760 Jul 12 13:15:37.566761 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-9e344ed8-f292-4967-8673-50124ea3d077 req-9d2d2898-fa18-40ae-bb2e-f1c6a9f0453f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097803 Jul 12 13:15:37.567852 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 29/53] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:37.571845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bec2ec10-aa25-4a1e-a39a-e3c81ba693d4 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:37.581496 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bec2ec10-aa25-4a1e-a39a-e3c81ba693d4 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 1.815950 Jul 12 13:15:37.586198 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 25/54] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:35 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:37.589178 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:37.593371 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:37.615507 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:37.616180 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:37.617167 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:37.617902 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:37.701435 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e99a4beb-8292-43d2-a3fd-05171e17e800 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:37.702930 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e99a4beb-8292-43d2-a3fd-05171e17e800 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:37.716435 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e99a4beb-8292-43d2-a3fd-05171e17e800 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:37.718154 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e99a4beb-8292-43d2-a3fd-05171e17e800 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:37.719003 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e99a4beb-8292-43d2-a3fd-05171e17e800 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:37.722140 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e99a4beb-8292-43d2-a3fd-05171e17e800 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:38.003523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:38.020873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:38.022394 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:38.035878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c50b7533-94c4-4afc-a1d1-cc38d97a6ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1337 microversion: 2.20 time: 0.453044 Jul 12 13:15:38.054519 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 30/55] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:37 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1337 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:38.204157 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e99a4beb-8292-43d2-a3fd-05171e17e800 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:38.228831 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e99a4beb-8292-43d2-a3fd-05171e17e800 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1299 microversion: 2.1 time: 0.525044 Jul 12 13:15:38.232272 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 26/56] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:37 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1299 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:38.485337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-358e6365-42eb-49be-b2d1-bd8da655502a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:38.487722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-358e6365-42eb-49be-b2d1-bd8da655502a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:38.514503 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-358e6365-42eb-49be-b2d1-bd8da655502a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:38.515329 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-358e6365-42eb-49be-b2d1-bd8da655502a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:38.516534 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-358e6365-42eb-49be-b2d1-bd8da655502a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:38.517460 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-358e6365-42eb-49be-b2d1-bd8da655502a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:38.603594 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5d85a2f3-7b78-4c1f-9914-f366d2a33558 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:38.607395 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5d85a2f3-7b78-4c1f-9914-f366d2a33558 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:38.614257 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:38.634538 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5d85a2f3-7b78-4c1f-9914-f366d2a33558 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:38.635841 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5d85a2f3-7b78-4c1f-9914-f366d2a33558 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:38.637133 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5d85a2f3-7b78-4c1f-9914-f366d2a33558 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:38.638085 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5d85a2f3-7b78-4c1f-9914-f366d2a33558 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:38.646318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:38.745606 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=24 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:39.040796 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-358e6365-42eb-49be-b2d1-bd8da655502a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:39.066066 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-358e6365-42eb-49be-b2d1-bd8da655502a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.587325 Jul 12 13:15:39.096604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 31/57] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:38 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:39.114106 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:39.117298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:39.128351 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:39.129435 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:39.130708 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:39.131542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:39.255146 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:39.280090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:39.290467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:39.292306 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5a2f5704-5305-41c2-8835-fa055cf36fcb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1337 microversion: 2.20 time: 0.194120 Jul 12 13:15:39.293166 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 32/58] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:39 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1337 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:39.323786 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cebdd802-d6ed-4cf9-9533-80c1dd6cb04c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:39.324674 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cebdd802-d6ed-4cf9-9533-80c1dd6cb04c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:39.339275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cebdd802-d6ed-4cf9-9533-80c1dd6cb04c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:39.339721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cebdd802-d6ed-4cf9-9533-80c1dd6cb04c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:39.340502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cebdd802-d6ed-4cf9-9533-80c1dd6cb04c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:39.340924 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cebdd802-d6ed-4cf9-9533-80c1dd6cb04c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:39.463879 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-cebdd802-d6ed-4cf9-9533-80c1dd6cb04c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:39.483046 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cebdd802-d6ed-4cf9-9533-80c1dd6cb04c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1299 microversion: 2.1 time: 0.175256 Jul 12 13:15:39.486620 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 33/59] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:39 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1299 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:39.704203 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5d85a2f3-7b78-4c1f-9914-f366d2a33558 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:39.722331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5d85a2f3-7b78-4c1f-9914-f366d2a33558 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 1.124145 Jul 12 13:15:39.723900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 27/60] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:38 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:40.102410 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9b9c3f72-7203-4027-a27a-07b49d92625a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:40.103173 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9b9c3f72-7203-4027-a27a-07b49d92625a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:40.111151 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9b9c3f72-7203-4027-a27a-07b49d92625a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:40.111626 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9b9c3f72-7203-4027-a27a-07b49d92625a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:40.112425 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9b9c3f72-7203-4027-a27a-07b49d92625a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:40.112861 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9b9c3f72-7203-4027-a27a-07b49d92625a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:40.310471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:40.311372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:40.322480 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:40.328001 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:40.329255 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:40.336306 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:40.365089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9b9c3f72-7203-4027-a27a-07b49d92625a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:40.388573 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9b9c3f72-7203-4027-a27a-07b49d92625a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.290185 Jul 12 13:15:40.400286 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 34/61] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:40 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:40.512022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5bcda40d-4c23-4e92-a13a-a3a2837ac41e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:40.514586 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-5bcda40d-4c23-4e92-a13a-a3a2837ac41e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:40.519673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=26 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:40.526566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:40.545640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5bcda40d-4c23-4e92-a13a-a3a2837ac41e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:40.547095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5bcda40d-4c23-4e92-a13a-a3a2837ac41e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:40.556237 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5bcda40d-4c23-4e92-a13a-a3a2837ac41e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:40.560084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5bcda40d-4c23-4e92-a13a-a3a2837ac41e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:40.637811 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=100 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:40.948277 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:40.951858 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5bcda40d-4c23-4e92-a13a-a3a2837ac41e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:40.960203 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:40.961892 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:40.962981 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5bcda40d-4c23-4e92-a13a-a3a2837ac41e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.463549 Jul 12 13:15:40.963549 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-49fded1f-9128-4ade-ac1f-c613abb62ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.656990 Jul 12 13:15:40.963655 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 35/62] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:40 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:40.968031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f96ac5d1-b7c8-44c3-81a3-b005ddac4a28 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:40.968625 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f96ac5d1-b7c8-44c3-81a3-b005ddac4a28 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:40.981257 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f96ac5d1-b7c8-44c3-81a3-b005ddac4a28 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:40.981867 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f96ac5d1-b7c8-44c3-81a3-b005ddac4a28 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:40.982915 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f96ac5d1-b7c8-44c3-81a3-b005ddac4a28 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:40.983557 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 28/63] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:40 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:40.983800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f96ac5d1-b7c8-44c3-81a3-b005ddac4a28 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:41.176015 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f96ac5d1-b7c8-44c3-81a3-b005ddac4a28 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:41.184781 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f96ac5d1-b7c8-44c3-81a3-b005ddac4a28 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.220160 Jul 12 13:15:41.185648 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 36/64] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:40 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:41.409411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-41bfa761-a522-42c7-96d1-6faf65ab23d4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:41.410361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-41bfa761-a522-42c7-96d1-6faf65ab23d4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:41.417348 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-41bfa761-a522-42c7-96d1-6faf65ab23d4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:41.417791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-41bfa761-a522-42c7-96d1-6faf65ab23d4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:41.418543 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-41bfa761-a522-42c7-96d1-6faf65ab23d4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:41.419418 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-41bfa761-a522-42c7-96d1-6faf65ab23d4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:41.730295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-41bfa761-a522-42c7-96d1-6faf65ab23d4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:41.747603 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-41bfa761-a522-42c7-96d1-6faf65ab23d4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.345625 Jul 12 13:15:41.748213 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 29/65] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:41 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:41.982609 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b7bf0ccc-9e5e-41de-b5b5-7209a335bc79 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:41.983827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b7bf0ccc-9e5e-41de-b5b5-7209a335bc79 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:41.989190 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:41.990347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:41.994150 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=8 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:41.994419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b7bf0ccc-9e5e-41de-b5b5-7209a335bc79 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:42.006238 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:42.006616 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b7bf0ccc-9e5e-41de-b5b5-7209a335bc79 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:42.007179 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:42.008110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:42.008760 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b7bf0ccc-9e5e-41de-b5b5-7209a335bc79 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:42.009800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b7bf0ccc-9e5e-41de-b5b5-7209a335bc79 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:42.010857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:42.247364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b7bf0ccc-9e5e-41de-b5b5-7209a335bc79 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:42.256595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b7bf0ccc-9e5e-41de-b5b5-7209a335bc79 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.281249 Jul 12 13:15:42.257191 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 37/66] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:41 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:42.268173 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=6 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:42.277463 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b49eb9e8-c94a-4b7b-be07-b2ceb6e028bd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:42.278372 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b49eb9e8-c94a-4b7b-be07-b2ceb6e028bd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:42.287417 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b49eb9e8-c94a-4b7b-be07-b2ceb6e028bd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:42.287863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b49eb9e8-c94a-4b7b-be07-b2ceb6e028bd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:42.288815 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b49eb9e8-c94a-4b7b-be07-b2ceb6e028bd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:42.289679 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b49eb9e8-c94a-4b7b-be07-b2ceb6e028bd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:42.385819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:42.396397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:42.398912 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:42.405982 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f4ce3a3e-68a4-4fbc-bc76-d1eaf10cec46 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.421428 Jul 12 13:15:42.410320 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 30/67] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:41 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:15:42.489104 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b49eb9e8-c94a-4b7b-be07-b2ceb6e028bd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:42.505521 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b49eb9e8-c94a-4b7b-be07-b2ceb6e028bd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.241102 Jul 12 13:15:42.506149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 38/68] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:42 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:42.768760 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5869ad26-c373-4a53-8c1b-ace032849350 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:42.769662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5869ad26-c373-4a53-8c1b-ace032849350 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:42.780036 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5869ad26-c373-4a53-8c1b-ace032849350 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:42.780520 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5869ad26-c373-4a53-8c1b-ace032849350 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:42.781379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5869ad26-c373-4a53-8c1b-ace032849350 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:42.781893 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5869ad26-c373-4a53-8c1b-ace032849350 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:43.117640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-3146075d-52d5-47c9-8deb-4f16af88258a req-a45f02c7-544f-4959-a9ec-d6eb6af3e17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55eb648a-8acd-4221-9b30-5fcabf1d4266", "tag": "60d74868-426c-4926-a466-31bbc0856014"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:43.133083 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-3146075d-52d5-47c9-8deb-4f16af88258a req-a45f02c7-544f-4959-a9ec-d6eb6af3e17c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:43.134734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-3146075d-52d5-47c9-8deb-4f16af88258a req-a45f02c7-544f-4959-a9ec-d6eb6af3e17c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:43.161707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-3146075d-52d5-47c9-8deb-4f16af88258a req-a45f02c7-544f-4959-a9ec-d6eb6af3e17c service nova] Creating event network-changed:60d74868-426c-4926-a466-31bbc0856014 for instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 on hv-cinder-79760 Jul 12 13:15:43.176218 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-3146075d-52d5-47c9-8deb-4f16af88258a req-a45f02c7-544f-4959-a9ec-d6eb6af3e17c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068760 Jul 12 13:15:43.180272 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 39/69] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:15:43.275339 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-19a49d4d-031c-4098-936c-20feee96fe0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:43.276046 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-19a49d4d-031c-4098-936c-20feee96fe0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:43.287456 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19a49d4d-031c-4098-936c-20feee96fe0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:43.287905 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19a49d4d-031c-4098-936c-20feee96fe0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:43.288820 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19a49d4d-031c-4098-936c-20feee96fe0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:43.289246 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19a49d4d-031c-4098-936c-20feee96fe0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:43.526419 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5869ad26-c373-4a53-8c1b-ace032849350 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:43.543394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5869ad26-c373-4a53-8c1b-ace032849350 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.771840 Jul 12 13:15:43.547456 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 31/70] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:42 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:43.568369 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:43.571204 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:43.588254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:43.592008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:43.592842 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:43.593274 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:43.844374 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-19a49d4d-031c-4098-936c-20feee96fe0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:43.859879 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-19a49d4d-031c-4098-936c-20feee96fe0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.589707 Jul 12 13:15:43.860518 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 40/71] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:43 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:43.865988 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f96cb654-7673-4aa5-a671-bd580d2a208d tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:43.866778 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f96cb654-7673-4aa5-a671-bd580d2a208d tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:43.882006 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f96cb654-7673-4aa5-a671-bd580d2a208d tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:43.882443 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f96cb654-7673-4aa5-a671-bd580d2a208d tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:43.889906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f96cb654-7673-4aa5-a671-bd580d2a208d tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:43.890806 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f96cb654-7673-4aa5-a671-bd580d2a208d tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:44.178099 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f96cb654-7673-4aa5-a671-bd580d2a208d tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:44.186794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f96cb654-7673-4aa5-a671-bd580d2a208d tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.324542 Jul 12 13:15:44.187712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 41/72] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:43 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:44.303886 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:44.312583 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:44.314166 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:44.317060 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-910a8edd-9ef7-4f2a-ae19-22288443ad1a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.768493 Jul 12 13:15:44.317631 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 32/73] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:43 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:44.564487 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d8c448ed-5b6a-44bb-8c9d-6f36a44b5d8d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:44.565364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d8c448ed-5b6a-44bb-8c9d-6f36a44b5d8d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:44.573266 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d8c448ed-5b6a-44bb-8c9d-6f36a44b5d8d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:44.574364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d8c448ed-5b6a-44bb-8c9d-6f36a44b5d8d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:44.575954 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d8c448ed-5b6a-44bb-8c9d-6f36a44b5d8d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:44.576574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d8c448ed-5b6a-44bb-8c9d-6f36a44b5d8d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:44.723971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d8c448ed-5b6a-44bb-8c9d-6f36a44b5d8d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:44.732297 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d8c448ed-5b6a-44bb-8c9d-6f36a44b5d8d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.172597 Jul 12 13:15:44.733367 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 42/74] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:44 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:44.878636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1396289d-df5a-4dc6-b918-4d433e13b655 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:44.879293 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1396289d-df5a-4dc6-b918-4d433e13b655 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:44.887034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1396289d-df5a-4dc6-b918-4d433e13b655 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:44.887641 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1396289d-df5a-4dc6-b918-4d433e13b655 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:44.888585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1396289d-df5a-4dc6-b918-4d433e13b655 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:44.889154 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1396289d-df5a-4dc6-b918-4d433e13b655 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:45.069602 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1396289d-df5a-4dc6-b918-4d433e13b655 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:45.078073 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1396289d-df5a-4dc6-b918-4d433e13b655 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.204420 Jul 12 13:15:45.079720 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 33/75] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:44 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:45.204632 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-661bd791-cd82-4166-a03f-f229d4d20830 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:45.206050 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-661bd791-cd82-4166-a03f-f229d4d20830 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:45.234872 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-661bd791-cd82-4166-a03f-f229d4d20830 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:45.238353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-661bd791-cd82-4166-a03f-f229d4d20830 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:45.243339 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-661bd791-cd82-4166-a03f-f229d4d20830 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:45.244846 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-661bd791-cd82-4166-a03f-f229d4d20830 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:45.264243 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-0ceb296a-e18c-4e74-b365-0a69037e21f8 req-10cd7833-61f9-4c83-bf78-3e55831e0f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a8f841-941e-4a72-a5c0-66cf4c1f7ebc", "tag": "aecd26f4-285f-454f-8ddb-ecfc55407ec5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:45.276349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-0ceb296a-e18c-4e74-b365-0a69037e21f8 req-10cd7833-61f9-4c83-bf78-3e55831e0f5d service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:45.277122 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-0ceb296a-e18c-4e74-b365-0a69037e21f8 req-10cd7833-61f9-4c83-bf78-3e55831e0f5d service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:45.291362 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-0ceb296a-e18c-4e74-b365-0a69037e21f8 req-10cd7833-61f9-4c83-bf78-3e55831e0f5d service nova] Creating event network-changed:aecd26f4-285f-454f-8ddb-ecfc55407ec5 for instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc on hv-cinder-79760 Jul 12 13:15:45.298362 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-0ceb296a-e18c-4e74-b365-0a69037e21f8 req-10cd7833-61f9-4c83-bf78-3e55831e0f5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037925 Jul 12 13:15:45.301777 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 34/76] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:15:45.337532 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:45.338505 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:45.354399 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:45.355427 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:45.357676 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:45.359917 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:45.551338 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:45.565222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-661bd791-cd82-4166-a03f-f229d4d20830 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:45.569496 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:45.576914 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:45.577993 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-661bd791-cd82-4166-a03f-f229d4d20830 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.372648 Jul 12 13:15:45.578124 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c3400341-7c5b-4e94-bea3-27d67f46b31d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.245633 Jul 12 13:15:45.578641 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 43/77] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:45 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:45.588412 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 35/78] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:45 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:45.752157 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cc6a28d0-c2ab-4bd0-bdde-400ca61b7175 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:45.752900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cc6a28d0-c2ab-4bd0-bdde-400ca61b7175 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:45.766718 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cc6a28d0-c2ab-4bd0-bdde-400ca61b7175 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:45.768950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cc6a28d0-c2ab-4bd0-bdde-400ca61b7175 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:45.770396 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cc6a28d0-c2ab-4bd0-bdde-400ca61b7175 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:45.773349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cc6a28d0-c2ab-4bd0-bdde-400ca61b7175 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:45.965082 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cc6a28d0-c2ab-4bd0-bdde-400ca61b7175 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:45.977096 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cc6a28d0-c2ab-4bd0-bdde-400ca61b7175 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.230391 Jul 12 13:15:45.978451 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 36/79] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:45 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:46.097140 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dbc0a16e-f0e8-45c8-8fec-d7d99e048318 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:46.099163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dbc0a16e-f0e8-45c8-8fec-d7d99e048318 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:46.106974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbc0a16e-f0e8-45c8-8fec-d7d99e048318 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:46.107732 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbc0a16e-f0e8-45c8-8fec-d7d99e048318 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:46.108847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbc0a16e-f0e8-45c8-8fec-d7d99e048318 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:46.109462 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbc0a16e-f0e8-45c8-8fec-d7d99e048318 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:46.462052 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dbc0a16e-f0e8-45c8-8fec-d7d99e048318 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:46.463583 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-88a5f4cf-17df-4406-8ca8-9d9dccf710e7 req-d76da1e8-0594-4892-a8c9-ed776c3f2364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185dde2b-5476-49f7-bf9d-65a6170bbbc7", "name": "network-vif-plugged", "status": "completed", "tag": "c0df3222-7842-45d4-a55f-acc681bd613c"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:46.478023 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dbc0a16e-f0e8-45c8-8fec-d7d99e048318 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.380661 Jul 12 13:15:46.478785 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 37/80] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:46 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:46.482968 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-88a5f4cf-17df-4406-8ca8-9d9dccf710e7 req-d76da1e8-0594-4892-a8c9-ed776c3f2364 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:46.483401 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-88a5f4cf-17df-4406-8ca8-9d9dccf710e7 req-d76da1e8-0594-4892-a8c9-ed776c3f2364 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:46.504701 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-88a5f4cf-17df-4406-8ca8-9d9dccf710e7 req-d76da1e8-0594-4892-a8c9-ed776c3f2364 service nova] Creating event network-vif-plugged:c0df3222-7842-45d4-a55f-acc681bd613c for instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 on hv-cinder-79760 Jul 12 13:15:46.509957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-88a5f4cf-17df-4406-8ca8-9d9dccf710e7 req-d76da1e8-0594-4892-a8c9-ed776c3f2364 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.439501 Jul 12 13:15:46.511218 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 44/81] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:46.599150 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:46.599861 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:46.603567 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-aa7354a9-4931-48c3-aee5-ac5cf21fe045 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:46.604444 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-aa7354a9-4931-48c3-aee5-ac5cf21fe045 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:46.620023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:46.622222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aa7354a9-4931-48c3-aee5-ac5cf21fe045 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:46.627420 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aa7354a9-4931-48c3-aee5-ac5cf21fe045 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:46.628449 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aa7354a9-4931-48c3-aee5-ac5cf21fe045 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:46.629221 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:46.629832 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aa7354a9-4931-48c3-aee5-ac5cf21fe045 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:46.630823 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:46.633245 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:47.174278 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:47.184489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:47.193217 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:47.196919 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2c8237d5-08c5-4f9f-9d36-d5ab4a7d8170 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.603121 Jul 12 13:15:47.199328 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 45/82] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:46 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:47.212520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-33183a6b-69f8-4fab-a851-b420bf774ff4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:47.215832 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-33183a6b-69f8-4fab-a851-b420bf774ff4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:47.233604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-33183a6b-69f8-4fab-a851-b420bf774ff4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:47.235893 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-33183a6b-69f8-4fab-a851-b420bf774ff4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:47.237089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-33183a6b-69f8-4fab-a851-b420bf774ff4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:47.237724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-33183a6b-69f8-4fab-a851-b420bf774ff4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:47.407613 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-aa7354a9-4931-48c3-aee5-ac5cf21fe045 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:47.421726 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-aa7354a9-4931-48c3-aee5-ac5cf21fe045 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.828507 Jul 12 13:15:47.433481 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 38/83] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:46 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:47.496594 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-97845382-2dd3-4de5-959c-75a23c1c5263 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:47.497393 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-97845382-2dd3-4de5-959c-75a23c1c5263 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:47.518944 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-97845382-2dd3-4de5-959c-75a23c1c5263 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:47.519502 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-97845382-2dd3-4de5-959c-75a23c1c5263 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:47.520286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-97845382-2dd3-4de5-959c-75a23c1c5263 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:47.520717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-97845382-2dd3-4de5-959c-75a23c1c5263 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:47.525536 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-33183a6b-69f8-4fab-a851-b420bf774ff4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:47.537359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-33183a6b-69f8-4fab-a851-b420bf774ff4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.335042 Jul 12 13:15:47.538224 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 46/84] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:47 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:47.768946 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-97845382-2dd3-4de5-959c-75a23c1c5263 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:47.794128 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-97845382-2dd3-4de5-959c-75a23c1c5263 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.301449 Jul 12 13:15:47.795333 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 39/85] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:47 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:48.219336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:48.220391 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:48.228246 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:48.229512 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:48.231743 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:48.232477 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:48.428559 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:48.440538 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:48.442156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f1be1910-5e9a-494c-9683-289ba258cad2 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:48.442785 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f1be1910-5e9a-494c-9683-289ba258cad2 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:48.443519 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:48.445534 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-30e5a6ad-cd96-470a-b28c-532f9b6d060d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.231880 Jul 12 13:15:48.451315 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f1be1910-5e9a-494c-9683-289ba258cad2 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:48.452356 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f1be1910-5e9a-494c-9683-289ba258cad2 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:48.453546 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f1be1910-5e9a-494c-9683-289ba258cad2 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:48.454378 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f1be1910-5e9a-494c-9683-289ba258cad2 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:48.456939 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 47/86] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:48 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:48.555156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-21cf5fba-1f6c-469d-8f9d-797e2d8d25f1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:48.556093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-21cf5fba-1f6c-469d-8f9d-797e2d8d25f1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:48.562604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21cf5fba-1f6c-469d-8f9d-797e2d8d25f1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:48.567764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21cf5fba-1f6c-469d-8f9d-797e2d8d25f1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:48.568839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21cf5fba-1f6c-469d-8f9d-797e2d8d25f1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:48.569186 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21cf5fba-1f6c-469d-8f9d-797e2d8d25f1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:48.727817 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f1be1910-5e9a-494c-9683-289ba258cad2 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:48.739481 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f1be1910-5e9a-494c-9683-289ba258cad2 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.302771 Jul 12 13:15:48.748990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 40/87] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:48 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:48.811728 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d14e774c-25e6-4b11-83f1-1b49cf07db38 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:48.812391 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d14e774c-25e6-4b11-83f1-1b49cf07db38 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:48.816300 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-21cf5fba-1f6c-469d-8f9d-797e2d8d25f1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:48.825721 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d14e774c-25e6-4b11-83f1-1b49cf07db38 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:48.826664 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d14e774c-25e6-4b11-83f1-1b49cf07db38 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:48.829827 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d14e774c-25e6-4b11-83f1-1b49cf07db38 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:48.830299 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-21cf5fba-1f6c-469d-8f9d-797e2d8d25f1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.278574 Jul 12 13:15:48.831166 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d14e774c-25e6-4b11-83f1-1b49cf07db38 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:48.832337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 48/88] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:48 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:48.998209 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d14e774c-25e6-4b11-83f1-1b49cf07db38 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:49.006625 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d14e774c-25e6-4b11-83f1-1b49cf07db38 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.199084 Jul 12 13:15:49.007506 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 41/89] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:48 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:49.464248 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:49.464916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:49.471095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:49.471700 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:49.473540 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:49.474321 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:49.629224 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:49.643352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:49.645079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:49.646222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3ea64bd9-01b5-4a14-83b2-77fc9f132be1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.186466 Jul 12 13:15:49.651176 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 49/90] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:49 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:49.756942 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-eccb6420-606e-481f-a32a-ea26465e5b01 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:49.757613 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-eccb6420-606e-481f-a32a-ea26465e5b01 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:49.772791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eccb6420-606e-481f-a32a-ea26465e5b01 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:49.773609 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eccb6420-606e-481f-a32a-ea26465e5b01 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:49.774571 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eccb6420-606e-481f-a32a-ea26465e5b01 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:49.775192 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eccb6420-606e-481f-a32a-ea26465e5b01 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:49.848303 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-57814b6d-60fc-4a03-ba91-cb98e5a82db8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:49.849142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-57814b6d-60fc-4a03-ba91-cb98e5a82db8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:49.856631 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-57814b6d-60fc-4a03-ba91-cb98e5a82db8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:49.857311 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-57814b6d-60fc-4a03-ba91-cb98e5a82db8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:49.858216 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-57814b6d-60fc-4a03-ba91-cb98e5a82db8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:49.858916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-57814b6d-60fc-4a03-ba91-cb98e5a82db8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:49.940872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-eccb6420-606e-481f-a32a-ea26465e5b01 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:49.950767 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-eccb6420-606e-481f-a32a-ea26465e5b01 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.198614 Jul 12 13:15:49.951813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 42/91] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:49 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:50.023838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-15e5745b-7a11-4544-b025-89a915bdde17 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:50.024508 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-15e5745b-7a11-4544-b025-89a915bdde17 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:50.034595 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-15e5745b-7a11-4544-b025-89a915bdde17 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:50.035075 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-15e5745b-7a11-4544-b025-89a915bdde17 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:50.037033 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-15e5745b-7a11-4544-b025-89a915bdde17 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:50.038642 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-15e5745b-7a11-4544-b025-89a915bdde17 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:50.056611 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-57814b6d-60fc-4a03-ba91-cb98e5a82db8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:50.079816 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-57814b6d-60fc-4a03-ba91-cb98e5a82db8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.233412 Jul 12 13:15:50.082211 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 50/92] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:49 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:50.273312 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-24e6c6d3-f9ca-4176-8f41-347e732603ed req-7867cd04-93ba-48fe-b5a7-4eb8c89a43a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882374fe-d7b8-4a2b-a70c-e7d15c9138c1", "name": "network-vif-plugged", "status": "completed", "tag": "d389aa10-6727-4171-84ec-b212c85b7728"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:50.288502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-24e6c6d3-f9ca-4176-8f41-347e732603ed req-7867cd04-93ba-48fe-b5a7-4eb8c89a43a5 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:50.288932 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-24e6c6d3-f9ca-4176-8f41-347e732603ed req-7867cd04-93ba-48fe-b5a7-4eb8c89a43a5 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:50.310228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-24e6c6d3-f9ca-4176-8f41-347e732603ed req-7867cd04-93ba-48fe-b5a7-4eb8c89a43a5 service nova] Creating event network-vif-plugged:d389aa10-6727-4171-84ec-b212c85b7728 for instance 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 on hv-cinder-79760 Jul 12 13:15:50.319155 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-24e6c6d3-f9ca-4176-8f41-347e732603ed req-7867cd04-93ba-48fe-b5a7-4eb8c89a43a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063818 Jul 12 13:15:50.321244 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 51/93] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:50.346401 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-15e5745b-7a11-4544-b025-89a915bdde17 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:50.359886 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-15e5745b-7a11-4544-b025-89a915bdde17 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.339735 Jul 12 13:15:50.360992 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 43/94] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:50 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:50.667770 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:50.669747 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:50.681354 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:50.683130 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:50.684558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:50.685187 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:50.891712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:50.905409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:50.908504 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:50.910031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-42d1c0e8-3e46-4687-a3bc-0738527d1239 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.249682 Jul 12 13:15:50.911529 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 52/95] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:50 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:50.971056 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a2d8f1c0-c6a7-453e-a0aa-8e3a1ee0bcdd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:50.971827 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a2d8f1c0-c6a7-453e-a0aa-8e3a1ee0bcdd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:50.984129 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2d8f1c0-c6a7-453e-a0aa-8e3a1ee0bcdd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:50.984637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2d8f1c0-c6a7-453e-a0aa-8e3a1ee0bcdd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:50.986157 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2d8f1c0-c6a7-453e-a0aa-8e3a1ee0bcdd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:50.986799 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2d8f1c0-c6a7-453e-a0aa-8e3a1ee0bcdd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:51.013345 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:51.098125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-37498395-c494-4c1c-a8e5-b94f37c19ce0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:51.098759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-37498395-c494-4c1c-a8e5-b94f37c19ce0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:51.110097 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-37498395-c494-4c1c-a8e5-b94f37c19ce0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:51.111155 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-37498395-c494-4c1c-a8e5-b94f37c19ce0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:51.112365 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-37498395-c494-4c1c-a8e5-b94f37c19ce0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:51.113035 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-37498395-c494-4c1c-a8e5-b94f37c19ce0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:51.239641 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a2d8f1c0-c6a7-453e-a0aa-8e3a1ee0bcdd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:51.251936 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a2d8f1c0-c6a7-453e-a0aa-8e3a1ee0bcdd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.285687 Jul 12 13:15:51.260438 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 44/96] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:50 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:51.313164 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-37498395-c494-4c1c-a8e5-b94f37c19ce0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:51.323821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-37498395-c494-4c1c-a8e5-b94f37c19ce0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1320 microversion: 2.1 time: 0.229959 Jul 12 13:15:51.332974 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 53/97] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:51 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1320 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:51.378305 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3b58c3f1-a4d5-4818-95c2-d2b5e972106e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:51.379059 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3b58c3f1-a4d5-4818-95c2-d2b5e972106e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:51.385876 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b58c3f1-a4d5-4818-95c2-d2b5e972106e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:51.386183 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b58c3f1-a4d5-4818-95c2-d2b5e972106e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:51.387068 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b58c3f1-a4d5-4818-95c2-d2b5e972106e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:51.387414 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3b58c3f1-a4d5-4818-95c2-d2b5e972106e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:51.577850 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3b58c3f1-a4d5-4818-95c2-d2b5e972106e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:51.588835 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3b58c3f1-a4d5-4818-95c2-d2b5e972106e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.215512 Jul 12 13:15:51.589622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 45/98] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:51 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:51.929343 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:51.930615 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:51.936947 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:51.937675 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:51.938712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:51.939392 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:51.943727 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=100 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:15:52.154198 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:52.168919 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:52.170441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:52.172846 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-edfc75d8-33bf-4c01-9194-f18520e89a0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.246327 Jul 12 13:15:52.172846 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 54/99] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:51 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:15:52.269610 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cb43d49a-ab89-41e8-869a-588338cfcc0b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:52.271108 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cb43d49a-ab89-41e8-869a-588338cfcc0b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:52.278566 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cb43d49a-ab89-41e8-869a-588338cfcc0b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:52.279339 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cb43d49a-ab89-41e8-869a-588338cfcc0b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:52.280348 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cb43d49a-ab89-41e8-869a-588338cfcc0b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:52.281011 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cb43d49a-ab89-41e8-869a-588338cfcc0b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:52.340791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-438c83d8-9e58-4984-9c17-f3e5c857dbed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:52.341676 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-438c83d8-9e58-4984-9c17-f3e5c857dbed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:52.348275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-438c83d8-9e58-4984-9c17-f3e5c857dbed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:52.349017 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-438c83d8-9e58-4984-9c17-f3e5c857dbed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:52.350491 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-438c83d8-9e58-4984-9c17-f3e5c857dbed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:52.351560 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-438c83d8-9e58-4984-9c17-f3e5c857dbed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:52.467606 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cb43d49a-ab89-41e8-869a-588338cfcc0b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:52.478768 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cb43d49a-ab89-41e8-869a-588338cfcc0b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.212932 Jul 12 13:15:52.489588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 46/100] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:52 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:52.494516 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-770dbf11-33a6-4fa4-ae68-2a8c8904551d req-91e5b19c-208a-498f-b59c-18e6cdb0a8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55eb648a-8acd-4221-9b30-5fcabf1d4266", "name": "network-vif-plugged", "status": "completed", "tag": "60d74868-426c-4926-a466-31bbc0856014"}, {"server_uuid": "07a8f841-941e-4a72-a5c0-66cf4c1f7ebc", "name": "network-vif-plugged", "status": "completed", "tag": "aecd26f4-285f-454f-8ddb-ecfc55407ec5"}, {"server_uuid": "aff5b881-a7b8-4dd9-abf9-c7972b9e68ef", "name": "network-vif-plugged", "status": "completed", "tag": "35b5d0a9-e77c-4780-8109-57c6b5712d76"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:52.506824 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-770dbf11-33a6-4fa4-ae68-2a8c8904551d req-91e5b19c-208a-498f-b59c-18e6cdb0a8ac service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:52.507465 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-770dbf11-33a6-4fa4-ae68-2a8c8904551d req-91e5b19c-208a-498f-b59c-18e6cdb0a8ac service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:52.524903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-770dbf11-33a6-4fa4-ae68-2a8c8904551d req-91e5b19c-208a-498f-b59c-18e6cdb0a8ac service nova] Creating event network-vif-plugged:60d74868-426c-4926-a466-31bbc0856014 for instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 on hv-cinder-79760 Jul 12 13:15:52.525629 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-770dbf11-33a6-4fa4-ae68-2a8c8904551d req-91e5b19c-208a-498f-b59c-18e6cdb0a8ac service nova] Creating event network-vif-plugged:aecd26f4-285f-454f-8ddb-ecfc55407ec5 for instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc on hv-cinder-79760 Jul 12 13:15:52.526408 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-770dbf11-33a6-4fa4-ae68-2a8c8904551d req-91e5b19c-208a-498f-b59c-18e6cdb0a8ac service nova] Creating event network-vif-plugged:35b5d0a9-e77c-4780-8109-57c6b5712d76 for instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef on hv-cinder-79760 Jul 12 13:15:52.537573 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-770dbf11-33a6-4fa4-ae68-2a8c8904551d req-91e5b19c-208a-498f-b59c-18e6cdb0a8ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046613 Jul 12 13:15:52.538411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 47/101] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:52.609635 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-294fe15a-30e3-4c76-92c1-2bc270976d55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:52.611637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-294fe15a-30e3-4c76-92c1-2bc270976d55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:52.620893 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-294fe15a-30e3-4c76-92c1-2bc270976d55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:52.621490 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-294fe15a-30e3-4c76-92c1-2bc270976d55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:52.622276 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-294fe15a-30e3-4c76-92c1-2bc270976d55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:52.622775 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-294fe15a-30e3-4c76-92c1-2bc270976d55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:52.842364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-438c83d8-9e58-4984-9c17-f3e5c857dbed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:52.852954 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-438c83d8-9e58-4984-9c17-f3e5c857dbed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1514 microversion: 2.1 time: 0.516681 Jul 12 13:15:52.853778 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 55/102] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:52 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1514 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:52.871375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-abfc8d35-aa58-439f-a378-968bed999136 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:52.873588 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-abfc8d35-aa58-439f-a378-968bed999136 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:52.881798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-294fe15a-30e3-4c76-92c1-2bc270976d55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:52.895321 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-294fe15a-30e3-4c76-92c1-2bc270976d55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.291888 Jul 12 13:15:52.904484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 48/103] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:52 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:52.904662 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-abfc8d35-aa58-439f-a378-968bed999136 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:52.904662 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-abfc8d35-aa58-439f-a378-968bed999136 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:52.904662 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-abfc8d35-aa58-439f-a378-968bed999136 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:52.904662 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-abfc8d35-aa58-439f-a378-968bed999136 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:53.011185 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-abfc8d35-aa58-439f-a378-968bed999136 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lazy-loading 'flavor' on Instance uuid 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:15:53.190809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:53.191733 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:53.200482 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:53.202146 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:53.203949 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:53.206117 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:53.262040 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-abfc8d35-aa58-439f-a378-968bed999136 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1/action" status: 200 len: 32 microversion: 2.1 time: 0.393772 Jul 12 13:15:53.264439 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 56/104] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:15:52 2022] POST /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1/action => generated 32 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 13:15:53.280434 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fc7b704c-6d93-4375-b5d0-abe641a107af tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:53.281356 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fc7b704c-6d93-4375-b5d0-abe641a107af tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:53.299838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc7b704c-6d93-4375-b5d0-abe641a107af tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:53.300288 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc7b704c-6d93-4375-b5d0-abe641a107af tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:53.302385 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc7b704c-6d93-4375-b5d0-abe641a107af tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:53.302503 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc7b704c-6d93-4375-b5d0-abe641a107af tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:53.428821 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:53.441785 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:53.443449 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:53.444653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a94906b4-b307-4134-88c3-79decbc6ad1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.259293 Jul 12 13:15:53.457956 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 49/105] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:53 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:53.497027 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d9143917-4077-4e31-998a-a77a475ed468 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:53.497878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d9143917-4077-4e31-998a-a77a475ed468 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:53.506296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9143917-4077-4e31-998a-a77a475ed468 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:53.507659 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9143917-4077-4e31-998a-a77a475ed468 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:53.508427 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9143917-4077-4e31-998a-a77a475ed468 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:53.508847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9143917-4077-4e31-998a-a77a475ed468 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:53.566734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fc7b704c-6d93-4375-b5d0-abe641a107af tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:53.581143 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fc7b704c-6d93-4375-b5d0-abe641a107af tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.309764 Jul 12 13:15:53.582652 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 57/106] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:53 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:53.680628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d9143917-4077-4e31-998a-a77a475ed468 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:53.690684 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d9143917-4077-4e31-998a-a77a475ed468 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.197663 Jul 12 13:15:53.696081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 50/107] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:53 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:53.913140 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-92497daa-31f6-4c56-bb8e-4d74a63752f7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:53.914394 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-92497daa-31f6-4c56-bb8e-4d74a63752f7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:53.927354 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-92497daa-31f6-4c56-bb8e-4d74a63752f7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:53.927806 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-92497daa-31f6-4c56-bb8e-4d74a63752f7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:53.928859 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-92497daa-31f6-4c56-bb8e-4d74a63752f7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:53.929598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-92497daa-31f6-4c56-bb8e-4d74a63752f7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:54.127709 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-92497daa-31f6-4c56-bb8e-4d74a63752f7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:54.140946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-92497daa-31f6-4c56-bb8e-4d74a63752f7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1367 microversion: 2.1 time: 0.230466 Jul 12 13:15:54.150830 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 58/108] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:53 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:54.465912 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:54.466647 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:54.473714 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:54.474279 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:54.475270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:54.475855 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:54.598013 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-07472909-a8fa-4b68-952b-cace275563a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:54.599302 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-07472909-a8fa-4b68-952b-cace275563a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:54.608133 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07472909-a8fa-4b68-952b-cace275563a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:54.608805 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07472909-a8fa-4b68-952b-cace275563a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:54.610082 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07472909-a8fa-4b68-952b-cace275563a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:54.610725 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07472909-a8fa-4b68-952b-cace275563a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:54.645698 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:54.658733 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:54.664571 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:54.665850 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0bace26e-2cb4-4108-b01f-c75998ab2f0f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1404 microversion: 2.20 time: 0.204253 Jul 12 13:15:54.667554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 51/109] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:54 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1404 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:54.709197 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b7eeaac9-db97-4819-b79b-0c322b577923 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:54.709852 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b7eeaac9-db97-4819-b79b-0c322b577923 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:54.717557 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b7eeaac9-db97-4819-b79b-0c322b577923 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:54.718007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b7eeaac9-db97-4819-b79b-0c322b577923 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:54.719206 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b7eeaac9-db97-4819-b79b-0c322b577923 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:54.720023 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b7eeaac9-db97-4819-b79b-0c322b577923 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:54.774019 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-07472909-a8fa-4b68-952b-cace275563a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:54.785244 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-07472909-a8fa-4b68-952b-cace275563a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.190983 Jul 12 13:15:54.786349 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 59/110] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:54 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:15:54.870133 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b7eeaac9-db97-4819-b79b-0c322b577923 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:54.883743 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b7eeaac9-db97-4819-b79b-0c322b577923 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1315 microversion: 2.1 time: 0.178411 Jul 12 13:15:54.885155 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 52/111] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:54 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:55.157735 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7365cdd5-25ad-4ca3-9ad9-78e3b3b6c959 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:55.158351 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7365cdd5-25ad-4ca3-9ad9-78e3b3b6c959 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:55.164647 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7365cdd5-25ad-4ca3-9ad9-78e3b3b6c959 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.165362 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7365cdd5-25ad-4ca3-9ad9-78e3b3b6c959 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:55.166307 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7365cdd5-25ad-4ca3-9ad9-78e3b3b6c959 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.166970 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7365cdd5-25ad-4ca3-9ad9-78e3b3b6c959 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:55.349566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7365cdd5-25ad-4ca3-9ad9-78e3b3b6c959 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:55.365773 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7365cdd5-25ad-4ca3-9ad9-78e3b3b6c959 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1556 microversion: 2.1 time: 0.211735 Jul 12 13:15:55.367378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 60/112] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:55 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:55.385002 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-25db5d84-1f08-4728-a198-42173b3a1918 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:55.385566 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-25db5d84-1f08-4728-a198-42173b3a1918 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:55.394858 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-25db5d84-1f08-4728-a198-42173b3a1918 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.396543 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-25db5d84-1f08-4728-a198-42173b3a1918 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:55.401370 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-25db5d84-1f08-4728-a198-42173b3a1918 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.402230 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-25db5d84-1f08-4728-a198-42173b3a1918 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:55.598585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-25db5d84-1f08-4728-a198-42173b3a1918 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.218477 Jul 12 13:15:55.605251 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 53/113] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 12 13:15:55 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:55.685475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:55.686238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:55.698546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.699117 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:55.703362 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.703863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:55.803386 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3ea60590-4472-45c7-9cba-5ad42c74258a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:55.804208 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3ea60590-4472-45c7-9cba-5ad42c74258a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:55.815368 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ea60590-4472-45c7-9cba-5ad42c74258a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.816217 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ea60590-4472-45c7-9cba-5ad42c74258a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:55.817136 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ea60590-4472-45c7-9cba-5ad42c74258a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.824025 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3ea60590-4472-45c7-9cba-5ad42c74258a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:55.929480 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:55.939961 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:55.942168 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:55.943309 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f9161242-f9f5-4552-8ce8-da3b7b789db0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1597 microversion: 2.20 time: 0.261894 Jul 12 13:15:55.943870 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 61/114] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:15:55 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1597 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:15:55.949435 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0f80fcd0-78db-4a09-901b-ad2c326036dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:55.950790 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0f80fcd0-78db-4a09-901b-ad2c326036dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:55.958590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0f80fcd0-78db-4a09-901b-ad2c326036dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.959428 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0f80fcd0-78db-4a09-901b-ad2c326036dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:55.960403 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0f80fcd0-78db-4a09-901b-ad2c326036dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:55.961257 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0f80fcd0-78db-4a09-901b-ad2c326036dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:56.115066 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0f80fcd0-78db-4a09-901b-ad2c326036dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:56.123727 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0f80fcd0-78db-4a09-901b-ad2c326036dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1502 microversion: 2.1 time: 0.178650 Jul 12 13:15:56.135453 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 62/115] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:55 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:56.142029 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2f33241a-0c55-4014-80e2-97f5139a9ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:56.142709 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2f33241a-0c55-4014-80e2-97f5139a9ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:56.149783 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2f33241a-0c55-4014-80e2-97f5139a9ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:56.150878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2f33241a-0c55-4014-80e2-97f5139a9ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:56.151818 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2f33241a-0c55-4014-80e2-97f5139a9ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:56.152398 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2f33241a-0c55-4014-80e2-97f5139a9ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:56.169520 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3ea60590-4472-45c7-9cba-5ad42c74258a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:56.178564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3ea60590-4472-45c7-9cba-5ad42c74258a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.379462 Jul 12 13:15:56.192456 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 54/116] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:55 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:56.309797 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2f33241a-0c55-4014-80e2-97f5139a9ca9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.172733 Jul 12 13:15:56.311273 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 63/117] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 12 13:15:56 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:15:57.197441 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fdfbc883-d1e1-42bf-80f1-42b05753cc0f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:57.198041 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fdfbc883-d1e1-42bf-80f1-42b05753cc0f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:57.209209 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdfbc883-d1e1-42bf-80f1-42b05753cc0f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:57.209653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdfbc883-d1e1-42bf-80f1-42b05753cc0f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:57.210420 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdfbc883-d1e1-42bf-80f1-42b05753cc0f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:57.210842 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdfbc883-d1e1-42bf-80f1-42b05753cc0f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:57.699253 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fdfbc883-d1e1-42bf-80f1-42b05753cc0f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:57.715302 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fdfbc883-d1e1-42bf-80f1-42b05753cc0f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.521520 Jul 12 13:15:57.717896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 55/118] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:57 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:57.831038 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d2c7b37d-78e6-49ce-9cce-0aa5a62b7f9a tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30af139f-e64f-4696-92ee-769ac5190be0"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:57.832155 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d2c7b37d-78e6-49ce-9cce-0aa5a62b7f9a tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:57.845609 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d2c7b37d-78e6-49ce-9cce-0aa5a62b7f9a tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:57.846044 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d2c7b37d-78e6-49ce-9cce-0aa5a62b7f9a tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:57.846810 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d2c7b37d-78e6-49ce-9cce-0aa5a62b7f9a tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:57.847261 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d2c7b37d-78e6-49ce-9cce-0aa5a62b7f9a tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:58.482045 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d2c7b37d-78e6-49ce-9cce-0aa5a62b7f9a tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "POST /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.654406 Jul 12 13:15:58.483426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 64/119] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:15:57 2022] POST /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:58.602851 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-6de74b42-54ce-4836-a57a-9975195dec03 req-4022354d-6693-4d3f-b927-691d6e5f56f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a8f841-941e-4a72-a5c0-66cf4c1f7ebc", "tag": "aecd26f4-285f-454f-8ddb-ecfc55407ec5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:58.619696 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-6de74b42-54ce-4836-a57a-9975195dec03 req-4022354d-6693-4d3f-b927-691d6e5f56f5 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:58.620904 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-6de74b42-54ce-4836-a57a-9975195dec03 req-4022354d-6693-4d3f-b927-691d6e5f56f5 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:58.662561 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-6de74b42-54ce-4836-a57a-9975195dec03 req-4022354d-6693-4d3f-b927-691d6e5f56f5 service nova] Creating event network-changed:aecd26f4-285f-454f-8ddb-ecfc55407ec5 for instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc on hv-cinder-79760 Jul 12 13:15:58.677781 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-6de74b42-54ce-4836-a57a-9975195dec03 req-4022354d-6693-4d3f-b927-691d6e5f56f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079585 Jul 12 13:15:58.678417 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 56/120] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:15:58.734821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-75be25ad-2ccb-4d62-8fb1-dd51643b02cc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:15:58.737291 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-75be25ad-2ccb-4d62-8fb1-dd51643b02cc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:15:58.754817 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75be25ad-2ccb-4d62-8fb1-dd51643b02cc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:58.759295 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75be25ad-2ccb-4d62-8fb1-dd51643b02cc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:58.765475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75be25ad-2ccb-4d62-8fb1-dd51643b02cc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:58.768284 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75be25ad-2ccb-4d62-8fb1-dd51643b02cc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:59.029972 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-75be25ad-2ccb-4d62-8fb1-dd51643b02cc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:15:59.042150 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-75be25ad-2ccb-4d62-8fb1-dd51643b02cc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.312133 Jul 12 13:15:59.049479 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 65/121] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:15:58 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:15:59.145171 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-ef4dfd14-8834-4f54-a1c5-a6b2fb7b4141 req-8f1691be-0939-43dd-ba8a-1602330f06ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55eb648a-8acd-4221-9b30-5fcabf1d4266", "tag": "60d74868-426c-4926-a466-31bbc0856014"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:15:59.163865 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ef4dfd14-8834-4f54-a1c5-a6b2fb7b4141 req-8f1691be-0939-43dd-ba8a-1602330f06ad service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:15:59.171918 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ef4dfd14-8834-4f54-a1c5-a6b2fb7b4141 req-8f1691be-0939-43dd-ba8a-1602330f06ad service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:15:59.224939 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-ef4dfd14-8834-4f54-a1c5-a6b2fb7b4141 req-8f1691be-0939-43dd-ba8a-1602330f06ad service nova] Creating event network-changed:60d74868-426c-4926-a466-31bbc0856014 for instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 on hv-cinder-79760 Jul 12 13:15:59.245501 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-ef4dfd14-8834-4f54-a1c5-a6b2fb7b4141 req-8f1691be-0939-43dd-ba8a-1602330f06ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104969 Jul 12 13:15:59.246805 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 57/122] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:00.066015 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3c9a891d-cc16-4321-9390-5c3ae6db5e44 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:00.066599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3c9a891d-cc16-4321-9390-5c3ae6db5e44 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:00.076047 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c9a891d-cc16-4321-9390-5c3ae6db5e44 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:00.082364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c9a891d-cc16-4321-9390-5c3ae6db5e44 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:00.083466 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c9a891d-cc16-4321-9390-5c3ae6db5e44 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:00.085528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c9a891d-cc16-4321-9390-5c3ae6db5e44 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:00.599462 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3c9a891d-cc16-4321-9390-5c3ae6db5e44 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:00.628500 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3c9a891d-cc16-4321-9390-5c3ae6db5e44 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.566255 Jul 12 13:16:00.631341 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 66/123] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:00 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:01.649117 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-43b11d51-01d2-4687-a992-d99a2af9a6f8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:01.650014 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-43b11d51-01d2-4687-a992-d99a2af9a6f8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:01.664787 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43b11d51-01d2-4687-a992-d99a2af9a6f8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:01.674517 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43b11d51-01d2-4687-a992-d99a2af9a6f8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:01.676390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43b11d51-01d2-4687-a992-d99a2af9a6f8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:01.677145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43b11d51-01d2-4687-a992-d99a2af9a6f8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:01.990134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-43b11d51-01d2-4687-a992-d99a2af9a6f8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:01.999012 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-43b11d51-01d2-4687-a992-d99a2af9a6f8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.355678 Jul 12 13:16:01.999809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 58/124] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:01 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:03.016935 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-75bb4ec2-e2d1-4ed5-8831-276d3f413977 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:03.017554 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-75bb4ec2-e2d1-4ed5-8831-276d3f413977 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:03.030037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75bb4ec2-e2d1-4ed5-8831-276d3f413977 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:03.030496 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75bb4ec2-e2d1-4ed5-8831-276d3f413977 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:03.031308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75bb4ec2-e2d1-4ed5-8831-276d3f413977 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:03.032091 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75bb4ec2-e2d1-4ed5-8831-276d3f413977 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:03.364236 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-75bb4ec2-e2d1-4ed5-8831-276d3f413977 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:03.368129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:03.379029 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-75bb4ec2-e2d1-4ed5-8831-276d3f413977 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.363730 Jul 12 13:16:03.379910 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 67/125] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:03 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:04.398545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-34cbd3ae-d787-4cfc-94b3-e98ad17e6392 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:04.403917 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-34cbd3ae-d787-4cfc-94b3-e98ad17e6392 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:04.420957 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34cbd3ae-d787-4cfc-94b3-e98ad17e6392 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:04.422426 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34cbd3ae-d787-4cfc-94b3-e98ad17e6392 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:04.423751 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34cbd3ae-d787-4cfc-94b3-e98ad17e6392 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:04.424405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34cbd3ae-d787-4cfc-94b3-e98ad17e6392 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:04.800954 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-34cbd3ae-d787-4cfc-94b3-e98ad17e6392 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:04.811432 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-34cbd3ae-d787-4cfc-94b3-e98ad17e6392 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.417217 Jul 12 13:16:04.813233 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 59/126] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:04 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:05.830491 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b28e906d-dead-4e10-8319-1b0b2a325b13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:05.831876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b28e906d-dead-4e10-8319-1b0b2a325b13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:05.861745 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b28e906d-dead-4e10-8319-1b0b2a325b13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:05.863518 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b28e906d-dead-4e10-8319-1b0b2a325b13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:05.864327 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b28e906d-dead-4e10-8319-1b0b2a325b13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:05.864766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b28e906d-dead-4e10-8319-1b0b2a325b13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:06.548480 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b28e906d-dead-4e10-8319-1b0b2a325b13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:06.557531 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b28e906d-dead-4e10-8319-1b0b2a325b13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.731084 Jul 12 13:16:06.558574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 68/127] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:05 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:07.578171 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fe0e40eb-f384-4d2c-b580-e05f69e5ed6e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:07.579129 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fe0e40eb-f384-4d2c-b580-e05f69e5ed6e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:07.591710 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe0e40eb-f384-4d2c-b580-e05f69e5ed6e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:07.592155 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe0e40eb-f384-4d2c-b580-e05f69e5ed6e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:07.592956 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe0e40eb-f384-4d2c-b580-e05f69e5ed6e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:07.593380 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe0e40eb-f384-4d2c-b580-e05f69e5ed6e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:07.691516 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-150f79a6-4711-4906-b9a2-bc7a1a8e3282 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:07.692797 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-150f79a6-4711-4906-b9a2-bc7a1a8e3282 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:07.728210 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-150f79a6-4711-4906-b9a2-bc7a1a8e3282 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:07.728995 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-150f79a6-4711-4906-b9a2-bc7a1a8e3282 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:07.731020 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-150f79a6-4711-4906-b9a2-bc7a1a8e3282 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:07.733099 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-150f79a6-4711-4906-b9a2-bc7a1a8e3282 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:07.819078 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-150f79a6-4711-4906-b9a2-bc7a1a8e3282 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:16:07.858237 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fe0e40eb-f384-4d2c-b580-e05f69e5ed6e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:07.870578 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fe0e40eb-f384-4d2c-b580-e05f69e5ed6e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.299357 Jul 12 13:16:07.871217 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 60/128] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:07 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:07.992492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-150f79a6-4711-4906-b9a2-bc7a1a8e3282 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 204 len: 0 microversion: 2.1 time: 0.313180 Jul 12 13:16:07.994481 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 69/129] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:16:07 2022] DELETE /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:16:08.005767 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c0da74a2-76b0-445c-a54e-772c1363e897 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:08.007622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c0da74a2-76b0-445c-a54e-772c1363e897 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:08.045402 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c0da74a2-76b0-445c-a54e-772c1363e897 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:08.048812 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c0da74a2-76b0-445c-a54e-772c1363e897 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:08.049725 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c0da74a2-76b0-445c-a54e-772c1363e897 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:08.050157 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c0da74a2-76b0-445c-a54e-772c1363e897 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:08.289234 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c0da74a2-76b0-445c-a54e-772c1363e897 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:08.303758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c0da74a2-76b0-445c-a54e-772c1363e897 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1554 microversion: 2.1 time: 0.301985 Jul 12 13:16:08.305934 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 61/130] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:07 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:08.890571 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a6500520-a414-4dc2-aeb2-cc39f04516c7 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:08.891558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a6500520-a414-4dc2-aeb2-cc39f04516c7 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:08.898281 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6500520-a414-4dc2-aeb2-cc39f04516c7 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:08.898731 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6500520-a414-4dc2-aeb2-cc39f04516c7 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:08.899651 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6500520-a414-4dc2-aeb2-cc39f04516c7 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:08.900217 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6500520-a414-4dc2-aeb2-cc39f04516c7 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:09.148518 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a6500520-a414-4dc2-aeb2-cc39f04516c7 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:09.156853 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a6500520-a414-4dc2-aeb2-cc39f04516c7 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.271987 Jul 12 13:16:09.157766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 70/131] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:08 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:09.321819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5c1b538a-82b0-473f-b35e-7c510a2458dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:09.323034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5c1b538a-82b0-473f-b35e-7c510a2458dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:09.326867 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=69 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:09.331378 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c1b538a-82b0-473f-b35e-7c510a2458dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:09.332101 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c1b538a-82b0-473f-b35e-7c510a2458dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:09.332870 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c1b538a-82b0-473f-b35e-7c510a2458dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:09.333464 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c1b538a-82b0-473f-b35e-7c510a2458dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:09.538079 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5c1b538a-82b0-473f-b35e-7c510a2458dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:09.554422 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5c1b538a-82b0-473f-b35e-7c510a2458dd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1554 microversion: 2.1 time: 0.237270 Jul 12 13:16:09.555645 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 62/132] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:09 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:09.902098 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1660938133", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "networks": [{"uuid": "2ae649db-ee2d-4766-be5a-4fb3219b7196"}]}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:09.967853 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] validate_networks() for [('2ae649db-ee2d-4766-be5a-4fb3219b7196', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:16:10.175568 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-45f38bef-ccdf-494b-92d4-d3fc91daeab4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:10.176449 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-45f38bef-ccdf-494b-92d4-d3fc91daeab4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:10.182782 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45f38bef-ccdf-494b-92d4-d3fc91daeab4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:10.183433 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45f38bef-ccdf-494b-92d4-d3fc91daeab4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:10.184434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45f38bef-ccdf-494b-92d4-d3fc91daeab4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:10.185237 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45f38bef-ccdf-494b-92d4-d3fc91daeab4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:10.218586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:10.368671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-45f38bef-ccdf-494b-92d4-d3fc91daeab4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:10.381087 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-45f38bef-ccdf-494b-92d4-d3fc91daeab4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.210292 Jul 12 13:16:10.382418 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 63/133] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:10 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:10.571840 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-08da5999-a857-4894-8d62-b97e050845b9 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:10.572504 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-08da5999-a857-4894-8d62-b97e050845b9 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:10.580460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-08da5999-a857-4894-8d62-b97e050845b9 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:10.580903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-08da5999-a857-4894-8d62-b97e050845b9 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:10.581931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-08da5999-a857-4894-8d62-b97e050845b9 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:10.582372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-08da5999-a857-4894-8d62-b97e050845b9 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:10.757551 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-08da5999-a857-4894-8d62-b97e050845b9 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:10.768283 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-08da5999-a857-4894-8d62-b97e050845b9 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1554 microversion: 2.1 time: 0.200376 Jul 12 13:16:10.770292 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 64/134] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:10 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:10.912425 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:16:10.913694 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:16:10.916754 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:16:10.917477 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:16:10.918110 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:16:10.922599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:10.939121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:10.940917 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:10.942490 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:10.943749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:10.975923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Getting quotas for project b93feeaa2e7644829dc24cd3c9a34941. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:16:10.986587 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Getting quotas for user 1524d3b8e0804388b57cccbc4451f73e and project b93feeaa2e7644829dc24cd3c9a34941. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:16:11.006876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:16:11.014859 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:16:11.144346 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f0e83813-2c0b-4c9d-953c-598fdf8f854f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.246346 Jul 12 13:16:11.146856 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 71/135] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:16:11.161447 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-10d644d8-d373-4707-812f-4cfcc9001fa1 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:11.162404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-10d644d8-d373-4707-812f-4cfcc9001fa1 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:11.301265 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-10d644d8-d373-4707-812f-4cfcc9001fa1 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:11.316220 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-10d644d8-d373-4707-812f-4cfcc9001fa1 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1214 microversion: 2.1 time: 0.160982 Jul 12 13:16:11.319370 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 65/136] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:11 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:11.399505 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ca0d3a77-5755-4902-9c34-e911f162bcc6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:11.400127 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ca0d3a77-5755-4902-9c34-e911f162bcc6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:11.407501 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ca0d3a77-5755-4902-9c34-e911f162bcc6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:11.421878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ca0d3a77-5755-4902-9c34-e911f162bcc6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:11.425177 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ca0d3a77-5755-4902-9c34-e911f162bcc6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:11.425966 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ca0d3a77-5755-4902-9c34-e911f162bcc6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:11.785820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6dd1e8f9-ba18-4415-a40d-63864a9e1620 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:11.786441 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6dd1e8f9-ba18-4415-a40d-63864a9e1620 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:11.799237 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6dd1e8f9-ba18-4415-a40d-63864a9e1620 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:11.799680 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6dd1e8f9-ba18-4415-a40d-63864a9e1620 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:11.800485 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6dd1e8f9-ba18-4415-a40d-63864a9e1620 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:11.800913 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6dd1e8f9-ba18-4415-a40d-63864a9e1620 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:12.090305 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6dd1e8f9-ba18-4415-a40d-63864a9e1620 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:12.108997 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6dd1e8f9-ba18-4415-a40d-63864a9e1620 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1554 microversion: 2.1 time: 0.323060 Jul 12 13:16:12.120374 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 66/137] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:11 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1554 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:12.335942 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b0a2d4d1-4100-4654-b70e-6eefbaad965e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:12.336571 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b0a2d4d1-4100-4654-b70e-6eefbaad965e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:12.346314 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0a2d4d1-4100-4654-b70e-6eefbaad965e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:12.347248 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0a2d4d1-4100-4654-b70e-6eefbaad965e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:12.348225 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0a2d4d1-4100-4654-b70e-6eefbaad965e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:12.348807 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0a2d4d1-4100-4654-b70e-6eefbaad965e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:12.442050 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ca0d3a77-5755-4902-9c34-e911f162bcc6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:12.448260 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b0a2d4d1-4100-4654-b70e-6eefbaad965e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:12.458815 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b0a2d4d1-4100-4654-b70e-6eefbaad965e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1266 microversion: 2.1 time: 0.127389 Jul 12 13:16:12.463642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ca0d3a77-5755-4902-9c34-e911f162bcc6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 1.067919 Jul 12 13:16:12.464487 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 72/138] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:11 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:12.464934 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 67/139] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:12 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:12.756710 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-b36878f4-4afe-456b-a163-79b7e7cc3825 req-8c474993-6988-4213-a3bc-7655778312ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff5b881-a7b8-4dd9-abf9-c7972b9e68ef", "name": "network-vif-deleted", "tag": "35b5d0a9-e77c-4780-8109-57c6b5712d76"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:12.784720 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-b36878f4-4afe-456b-a163-79b7e7cc3825 req-8c474993-6988-4213-a3bc-7655778312ef service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:12.785566 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-b36878f4-4afe-456b-a163-79b7e7cc3825 req-8c474993-6988-4213-a3bc-7655778312ef service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:12.816883 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-b36878f4-4afe-456b-a163-79b7e7cc3825 req-8c474993-6988-4213-a3bc-7655778312ef service nova] Creating event network-vif-deleted:35b5d0a9-e77c-4780-8109-57c6b5712d76 for instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef on hv-cinder-79760 Jul 12 13:16:12.838693 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-b36878f4-4afe-456b-a163-79b7e7cc3825 req-8c474993-6988-4213-a3bc-7655778312ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090850 Jul 12 13:16:12.839499 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 68/140] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:13.137420 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0c78ebb0-c0ae-4bf6-99e1-324882d14fda tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:13.138019 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0c78ebb0-c0ae-4bf6-99e1-324882d14fda tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:13.156153 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0c78ebb0-c0ae-4bf6-99e1-324882d14fda tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:13.157061 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0c78ebb0-c0ae-4bf6-99e1-324882d14fda tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:13.158162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0c78ebb0-c0ae-4bf6-99e1-324882d14fda tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:13.158864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0c78ebb0-c0ae-4bf6-99e1-324882d14fda tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:13.252154 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0c78ebb0-c0ae-4bf6-99e1-324882d14fda tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:13.265989 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0c78ebb0-c0ae-4bf6-99e1-324882d14fda tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1346 microversion: 2.1 time: 0.132217 Jul 12 13:16:13.267072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 73/141] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:13 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:13.482919 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-52fb5348-2ca0-4769-9259-8c308796c602 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:13.483181 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b6619a63-df66-46a3-9b97-6d2faabb8e4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:13.483641 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b6619a63-df66-46a3-9b97-6d2faabb8e4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:13.484797 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-52fb5348-2ca0-4769-9259-8c308796c602 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:13.496675 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6619a63-df66-46a3-9b97-6d2faabb8e4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:13.497152 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6619a63-df66-46a3-9b97-6d2faabb8e4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:13.498064 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6619a63-df66-46a3-9b97-6d2faabb8e4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:13.498495 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6619a63-df66-46a3-9b97-6d2faabb8e4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:13.510566 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52fb5348-2ca0-4769-9259-8c308796c602 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:13.511294 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52fb5348-2ca0-4769-9259-8c308796c602 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:13.512512 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52fb5348-2ca0-4769-9259-8c308796c602 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:13.513814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52fb5348-2ca0-4769-9259-8c308796c602 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:13.907393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b6619a63-df66-46a3-9b97-6d2faabb8e4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:13.942175 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b6619a63-df66-46a3-9b97-6d2faabb8e4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.456116 Jul 12 13:16:13.959502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 74/142] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:13 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:14.018755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-52fb5348-2ca0-4769-9259-8c308796c602 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:14.034192 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-52fb5348-2ca0-4769-9259-8c308796c602 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1272 microversion: 2.1 time: 0.553550 Jul 12 13:16:14.054758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 69/143] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:13 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1272 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:14.286870 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:14.287683 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:14.304064 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:14.308391 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:14.311013 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:14.312549 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:14.392069 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:14.402338 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:14.403296 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lazy-loading 'fault' on Instance uuid aff5b881-a7b8-4dd9-abf9-c7972b9e68ef {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:16:14.550543 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34699f2119154c5f87c115490317eaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad474240c3a746d78ea5289f09ca4d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:14.596105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2fe4bbef-171c-4c71-b8b4-52a361e8f76b tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 200 len: 1351 microversion: 2.1 time: 0.299035 Jul 12 13:16:14.597474 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 75/144] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:14 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 1351 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:14.961445 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a64c2467-566c-4e28-8c38-d649f50a16e9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:14.962055 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a64c2467-566c-4e28-8c38-d649f50a16e9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:14.985236 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a64c2467-566c-4e28-8c38-d649f50a16e9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:14.992025 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a64c2467-566c-4e28-8c38-d649f50a16e9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:14.993369 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a64c2467-566c-4e28-8c38-d649f50a16e9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:14.994291 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a64c2467-566c-4e28-8c38-d649f50a16e9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:15.070534 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-98754356-5150-4978-9e49-ceec242de357 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:15.077183 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-98754356-5150-4978-9e49-ceec242de357 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:15.095094 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98754356-5150-4978-9e49-ceec242de357 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:15.095758 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98754356-5150-4978-9e49-ceec242de357 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:15.096594 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98754356-5150-4978-9e49-ceec242de357 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:15.097032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98754356-5150-4978-9e49-ceec242de357 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:15.304229 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a64c2467-566c-4e28-8c38-d649f50a16e9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:15.319925 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a64c2467-566c-4e28-8c38-d649f50a16e9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.360138 Jul 12 13:16:15.320570 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 70/145] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:14 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:15.455416 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-98754356-5150-4978-9e49-ceec242de357 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:15.463893 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-98754356-5150-4978-9e49-ceec242de357 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1314 microversion: 2.1 time: 0.406545 Jul 12 13:16:15.468942 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 76/146] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:15 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:15.614543 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:15.615450 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:15.624672 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:15.627461 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:15.629729 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:15.631555 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:15.662662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] HTTP exception thrown: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Request method failure captured: Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef HTTP/1.1 Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPkrg1aQUcmxIDvsfsAt8X3VRov0i66rwaJF4e8_fJdiFGsb4TdUvrfKlxzSCrPlkAX4JrrBULsMUWPommKkORPZQgfFxmw_fYyRfznnc6Ws_wqyJSEwI73MT0cFzJkG_7sjnpcVU4Cge6I8auCqW8KgPfFUXPjcYl0snOUpnir-cY Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: ad474240c3a746d78ea5289f09ca4d97 Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:16:15.675899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: ad474240c3a746d78ea5289f09ca4d97 Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-DeleteServersTestJSON-1321883403-project Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 34699f2119154c5f87c115490317eaf3 Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-DeleteServersTestJSON-1321883403-project Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:15.677544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': 'aff5b881-a7b8-4dd9-abf9-c7972b9e68ef'} Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:16:15.678394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:15.679711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:15.680910 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Returning 404 to user: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:16:15.680910 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-84f43a36-8a21-4439-a5a6-f3a037054007 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 404 len: 111 microversion: 2.1 time: 0.067215 Jul 12 13:16:15.680910 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 71/147] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:15 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:16:16.062735 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:16.064722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:16.078261 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:16.083686 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:16.085726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:16.087739 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:16.107960 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] HTTP exception thrown: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Request method failure captured: Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef/os-volume_attachments HTTP/1.1 Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPkrg1aQUcmxIDvsfsAt8X3VRov0i66rwaJF4e8_fJdiFGsb4TdUvrfKlxzSCrPlkAX4JrrBULsMUWPommKkORPZQgfFxmw_fYyRfznnc6Ws_wqyJSEwI73MT0cFzJkG_7sjnpcVU4Cge6I8auCqW8KgPfFUXPjcYl0snOUpnir-cY Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: ad474240c3a746d78ea5289f09ca4d97 Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:16:16.113072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: ad474240c3a746d78ea5289f09ca4d97 Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-DeleteServersTestJSON-1321883403-project Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 34699f2119154c5f87c115490317eaf3 Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-DeleteServersTestJSON-1321883403-project Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:16.114520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'server_id': 'aff5b881-a7b8-4dd9-abf9-c7972b9e68ef'} Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:16:16.115623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:16.116658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:16.120377 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Returning 404 to user: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:16:16.122518 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-eff00a28-adc2-49d0-be95-4b0f19a285bf tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064231 Jul 12 13:16:16.124459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 77/148] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:16:16 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef/os-volume_attachments => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:16:16.142862 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-7dc0162b-2f28-4527-8c1b-bb2a8eccedbb req-e5c68643-a0d7-4ae6-9372-27863a1e957f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46e690cd-45ab-4f63-bb8c-5f5f0741ce3b", "tag": "88285b3f-5c4a-496c-9336-249476e237b5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:16.157658 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-7dc0162b-2f28-4527-8c1b-bb2a8eccedbb req-e5c68643-a0d7-4ae6-9372-27863a1e957f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:16.158383 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-7dc0162b-2f28-4527-8c1b-bb2a8eccedbb req-e5c68643-a0d7-4ae6-9372-27863a1e957f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:16.177412 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-7dc0162b-2f28-4527-8c1b-bb2a8eccedbb req-e5c68643-a0d7-4ae6-9372-27863a1e957f service nova] Creating event network-changed:88285b3f-5c4a-496c-9336-249476e237b5 for instance 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b on hv-cinder-79760 Jul 12 13:16:16.184134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-7dc0162b-2f28-4527-8c1b-bb2a8eccedbb req-e5c68643-a0d7-4ae6-9372-27863a1e957f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050542 Jul 12 13:16:16.184743 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 72/149] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:16.343202 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-27febe2b-9fdc-4833-8474-d39d48102a9c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:16.345789 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-27febe2b-9fdc-4833-8474-d39d48102a9c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:16.363420 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-27febe2b-9fdc-4833-8474-d39d48102a9c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:16.366724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-27febe2b-9fdc-4833-8474-d39d48102a9c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:16.367614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-27febe2b-9fdc-4833-8474-d39d48102a9c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:16.370878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-27febe2b-9fdc-4833-8474-d39d48102a9c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:16.487188 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2f95b968-9015-4201-9a1e-b7ca8f28ab2a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:16.487914 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2f95b968-9015-4201-9a1e-b7ca8f28ab2a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:16.505909 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f95b968-9015-4201-9a1e-b7ca8f28ab2a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:16.533006 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f95b968-9015-4201-9a1e-b7ca8f28ab2a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:16.534308 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f95b968-9015-4201-9a1e-b7ca8f28ab2a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:16.542140 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f95b968-9015-4201-9a1e-b7ca8f28ab2a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:16.866791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-27febe2b-9fdc-4833-8474-d39d48102a9c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:16.891127 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-27febe2b-9fdc-4833-8474-d39d48102a9c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.542943 Jul 12 13:16:16.892214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 78/150] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:16 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:17.036283 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2f95b968-9015-4201-9a1e-b7ca8f28ab2a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:17.044484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2f95b968-9015-4201-9a1e-b7ca8f28ab2a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1314 microversion: 2.1 time: 0.562747 Jul 12 13:16:17.045086 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 73/151] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:16 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:17.384835 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5db8524c-b269-4a6b-baf3-dc18c134e2b9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Action: 'create', calling method: .version_select at 0x7fd48ee844c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-98640609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqC8uYllctmPr8wdOVeWAFvgvk3cHFQmMh5l1M+WEy/KUhHdYg+Mk/c4b6/64q7BBNlpqlV6ex70EeTMqHtrwwM+wMWwXrlDOToG3UT+dXJadNAJjGzRAPlMxS3gWf99A=="}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:17.404428 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-5db8524c-b269-4a6b-baf3-dc18c134e2b9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Getting quotas for project 106ea1b5dcdf45a2a18fc882d8b49782. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:16:17.409438 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-5db8524c-b269-4a6b-baf3-dc18c134e2b9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Getting quotas for user e6a2edc70216491fa7e2c4d2e28d050f and project 106ea1b5dcdf45a2a18fc882d8b49782. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:16:17.448465 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5db8524c-b269-4a6b-baf3-dc18c134e2b9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.275723 Jul 12 13:16:17.449091 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 79/152] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:16:17 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:17.571086 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:17.572184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:17.578922 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:17.579380 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:17.580133 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:17.580548 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:17.600758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] HTTP exception thrown: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Request method failure captured: Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef HTTP/1.1 Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPkrg1aQUcmxIDvsfsAt8X3VRov0i66rwaJF4e8_fJdiFGsb4TdUvrfKlxzSCrPlkAX4JrrBULsMUWPommKkORPZQgfFxmw_fYyRfznnc6Ws_wqyJSEwI73MT0cFzJkG_7sjnpcVU4Cge6I8auCqW8KgPfFUXPjcYl0snOUpnir-cY Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: ad474240c3a746d78ea5289f09ca4d97 Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:16:17.603711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: ad474240c3a746d78ea5289f09ca4d97 Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-DeleteServersTestJSON-1321883403-project Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 34699f2119154c5f87c115490317eaf3 Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-DeleteServersTestJSON-1321883403-project Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.605178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': 'aff5b881-a7b8-4dd9-abf9-c7972b9e68ef'} Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:16:17.605943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.607666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.609509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Returning 404 to user: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:16:17.609509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-45093796-a940-458f-a1d6-8cd6fd6cd7cd tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 404 len: 111 microversion: 2.1 time: 0.038938 Jul 12 13:16:17.609509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 74/153] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:16:17 2022] DELETE /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:16:17.616470 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:17.617268 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] [instance: aff5b881-a7b8-4dd9-abf9-c7972b9e68ef] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:17.625139 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:17.625139 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:17.626322 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:17.626741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:17.643938 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] HTTP exception thrown: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Request method failure captured: Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef HTTP/1.1 Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPkrg1aQUcmxIDvsfsAt8X3VRov0i66rwaJF4e8_fJdiFGsb4TdUvrfKlxzSCrPlkAX4JrrBULsMUWPommKkORPZQgfFxmw_fYyRfznnc6Ws_wqyJSEwI73MT0cFzJkG_7sjnpcVU4Cge6I8auCqW8KgPfFUXPjcYl0snOUpnir-cY Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: ad474240c3a746d78ea5289f09ca4d97 Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:16:17.646426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad474240c3a746d78ea5289f09ca4d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: ad474240c3a746d78ea5289f09ca4d97 Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321883403 Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-DeleteServersTestJSON-1321883403-project Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 34699f2119154c5f87c115490317eaf3 Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-DeleteServersTestJSON-1321883403-project Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.647971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': 'aff5b881-a7b8-4dd9-abf9-c7972b9e68ef'} Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:16:17.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. Jul 12 13:16:17.652352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:17.653532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] Returning 404 to user: Instance aff5b881-a7b8-4dd9-abf9-c7972b9e68ef could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:16:17.653532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3be7176c-ca1b-4d8f-bc29-2f371c942f02 tempest-DeleteServersTestJSON-1321883403 tempest-DeleteServersTestJSON-1321883403-project] 10.222.0.33 "GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef" status: 404 len: 111 microversion: 2.1 time: 0.036314 Jul 12 13:16:17.653532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 80/154] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:17 2022] GET /compute/v2.1/servers/aff5b881-a7b8-4dd9-abf9-c7972b9e68ef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:16:17.910290 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0301d53b-8bdf-4070-9cef-113a440079ac tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:17.910993 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0301d53b-8bdf-4070-9cef-113a440079ac tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:17.921078 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0301d53b-8bdf-4070-9cef-113a440079ac tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:17.921998 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0301d53b-8bdf-4070-9cef-113a440079ac tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:17.925259 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0301d53b-8bdf-4070-9cef-113a440079ac tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:17.925869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0301d53b-8bdf-4070-9cef-113a440079ac tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:18.062562 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fddfb7e9-02b7-41f6-b10d-c42726d5703c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:18.063447 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fddfb7e9-02b7-41f6-b10d-c42726d5703c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:18.077114 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fddfb7e9-02b7-41f6-b10d-c42726d5703c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:18.078813 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fddfb7e9-02b7-41f6-b10d-c42726d5703c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:18.082409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fddfb7e9-02b7-41f6-b10d-c42726d5703c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:18.086626 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fddfb7e9-02b7-41f6-b10d-c42726d5703c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:18.259008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0301d53b-8bdf-4070-9cef-113a440079ac tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:18.267526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0301d53b-8bdf-4070-9cef-113a440079ac tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.362439 Jul 12 13:16:18.268350 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 75/155] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:17 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:18.528786 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fddfb7e9-02b7-41f6-b10d-c42726d5703c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:18.539541 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fddfb7e9-02b7-41f6-b10d-c42726d5703c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1314 microversion: 2.1 time: 0.479861 Jul 12 13:16:18.551323 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 81/156] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:18 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:19.289045 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-18a835d8-a063-45d7-87be-0d1d928e310e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:19.289957 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-18a835d8-a063-45d7-87be-0d1d928e310e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:19.308411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18a835d8-a063-45d7-87be-0d1d928e310e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:19.308931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18a835d8-a063-45d7-87be-0d1d928e310e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:19.309872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18a835d8-a063-45d7-87be-0d1d928e310e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:19.310300 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-18a835d8-a063-45d7-87be-0d1d928e310e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:19.558526 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0d5df4a2-d530-45e2-850a-5a5311a9bf2d tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:19.561304 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0d5df4a2-d530-45e2-850a-5a5311a9bf2d tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:19.575118 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0d5df4a2-d530-45e2-850a-5a5311a9bf2d tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:19.575787 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0d5df4a2-d530-45e2-850a-5a5311a9bf2d tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:19.576720 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0d5df4a2-d530-45e2-850a-5a5311a9bf2d tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:19.580190 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0d5df4a2-d530-45e2-850a-5a5311a9bf2d tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:19.662043 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-18a835d8-a063-45d7-87be-0d1d928e310e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:19.675530 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-18a835d8-a063-45d7-87be-0d1d928e310e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.393526 Jul 12 13:16:19.676680 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 76/157] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:19 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:19.855382 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0d5df4a2-d530-45e2-850a-5a5311a9bf2d tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:19.866553 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0d5df4a2-d530-45e2-850a-5a5311a9bf2d tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1314 microversion: 2.1 time: 0.312295 Jul 12 13:16:19.877866 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 82/158] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:19 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:20.693669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b207b848-19fa-4446-9c43-c5aad9ee8d27 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:20.695041 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b207b848-19fa-4446-9c43-c5aad9ee8d27 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:20.707089 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b207b848-19fa-4446-9c43-c5aad9ee8d27 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:20.707778 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b207b848-19fa-4446-9c43-c5aad9ee8d27 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:20.710475 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b207b848-19fa-4446-9c43-c5aad9ee8d27 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:20.711147 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b207b848-19fa-4446-9c43-c5aad9ee8d27 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:20.886281 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-863657dc-537e-447f-bbf3-10ee592582f8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:20.887050 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-863657dc-537e-447f-bbf3-10ee592582f8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:20.902055 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-863657dc-537e-447f-bbf3-10ee592582f8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:20.905308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-863657dc-537e-447f-bbf3-10ee592582f8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:20.914367 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-863657dc-537e-447f-bbf3-10ee592582f8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:20.915883 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-863657dc-537e-447f-bbf3-10ee592582f8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:20.966528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:21.163786 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-863657dc-537e-447f-bbf3-10ee592582f8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:21.174644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-863657dc-537e-447f-bbf3-10ee592582f8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1314 microversion: 2.1 time: 0.292926 Jul 12 13:16:21.176015 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 83/159] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:20 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:21.313736 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:21.380081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b207b848-19fa-4446-9c43-c5aad9ee8d27 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:21.393247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b207b848-19fa-4446-9c43-c5aad9ee8d27 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.704123 Jul 12 13:16:21.393838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 77/160] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:20 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:22.192350 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3e0fbf1f-bef9-4039-a8a3-d52d30f729e0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:22.192906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3e0fbf1f-bef9-4039-a8a3-d52d30f729e0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:22.206008 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e0fbf1f-bef9-4039-a8a3-d52d30f729e0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:22.206772 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e0fbf1f-bef9-4039-a8a3-d52d30f729e0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:22.216032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e0fbf1f-bef9-4039-a8a3-d52d30f729e0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:22.216676 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e0fbf1f-bef9-4039-a8a3-d52d30f729e0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:22.342664 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-a151628f-6bfc-4fee-a248-b54071216ad1 req-c67a0911-b9fa-49b5-84d9-17c7134f15ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e690cd-45ab-4f63-bb8c-5f5f0741ce3b", "name": "network-vif-plugged", "status": "completed", "tag": "88285b3f-5c4a-496c-9336-249476e237b5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:22.356713 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-a151628f-6bfc-4fee-a248-b54071216ad1 req-c67a0911-b9fa-49b5-84d9-17c7134f15ee service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:22.357273 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-a151628f-6bfc-4fee-a248-b54071216ad1 req-c67a0911-b9fa-49b5-84d9-17c7134f15ee service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:22.371206 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-a151628f-6bfc-4fee-a248-b54071216ad1 req-c67a0911-b9fa-49b5-84d9-17c7134f15ee service nova] Creating event network-vif-plugged:88285b3f-5c4a-496c-9336-249476e237b5 for instance 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b on hv-cinder-79760 Jul 12 13:16:22.377062 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-a151628f-6bfc-4fee-a248-b54071216ad1 req-c67a0911-b9fa-49b5-84d9-17c7134f15ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039277 Jul 12 13:16:22.378267 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 78/161] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:22.419792 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c8b149d4-a888-49da-93e9-b129b2e709f3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:22.421595 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c8b149d4-a888-49da-93e9-b129b2e709f3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:22.435741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3e0fbf1f-bef9-4039-a8a3-d52d30f729e0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:22.445086 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3e0fbf1f-bef9-4039-a8a3-d52d30f729e0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1314 microversion: 2.1 time: 0.257318 Jul 12 13:16:22.445982 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 84/162] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:22 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:22.455808 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c8b149d4-a888-49da-93e9-b129b2e709f3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:22.459197 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c8b149d4-a888-49da-93e9-b129b2e709f3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:22.463630 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c8b149d4-a888-49da-93e9-b129b2e709f3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:22.464168 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c8b149d4-a888-49da-93e9-b129b2e709f3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:22.743719 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c8b149d4-a888-49da-93e9-b129b2e709f3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:22.753442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c8b149d4-a888-49da-93e9-b129b2e709f3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.346497 Jul 12 13:16:22.753869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 79/163] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:22 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:23.463185 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d37a2ed8-a4fb-4344-ba4e-e48bc13cdf93 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:23.463765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d37a2ed8-a4fb-4344-ba4e-e48bc13cdf93 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:23.470675 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d37a2ed8-a4fb-4344-ba4e-e48bc13cdf93 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:23.471078 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d37a2ed8-a4fb-4344-ba4e-e48bc13cdf93 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:23.471830 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d37a2ed8-a4fb-4344-ba4e-e48bc13cdf93 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:23.472427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d37a2ed8-a4fb-4344-ba4e-e48bc13cdf93 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:23.491493 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:23.736293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d37a2ed8-a4fb-4344-ba4e-e48bc13cdf93 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:23.754769 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d37a2ed8-a4fb-4344-ba4e-e48bc13cdf93 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1314 microversion: 2.1 time: 0.295385 Jul 12 13:16:23.755697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 85/164] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:23 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:23.773101 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dd522518-03ca-465a-8cdb-49c17a2645b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:23.773700 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dd522518-03ca-465a-8cdb-49c17a2645b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:23.780947 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dd522518-03ca-465a-8cdb-49c17a2645b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:23.781389 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dd522518-03ca-465a-8cdb-49c17a2645b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:23.782161 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dd522518-03ca-465a-8cdb-49c17a2645b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:23.782590 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dd522518-03ca-465a-8cdb-49c17a2645b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:24.056345 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dd522518-03ca-465a-8cdb-49c17a2645b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:24.074697 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dd522518-03ca-465a-8cdb-49c17a2645b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.303665 Jul 12 13:16:24.075380 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 80/165] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:23 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:24.775481 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0b9496b4-d117-4f96-9be0-1eb58157a125 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:24.776134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0b9496b4-d117-4f96-9be0-1eb58157a125 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:24.785092 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0b9496b4-d117-4f96-9be0-1eb58157a125 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:24.785736 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0b9496b4-d117-4f96-9be0-1eb58157a125 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:24.787947 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0b9496b4-d117-4f96-9be0-1eb58157a125 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:24.788822 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0b9496b4-d117-4f96-9be0-1eb58157a125 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:24.947169 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0b9496b4-d117-4f96-9be0-1eb58157a125 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:24.956382 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0b9496b4-d117-4f96-9be0-1eb58157a125 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1498 microversion: 2.1 time: 0.187971 Jul 12 13:16:24.957029 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 86/166] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:24 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:25.092624 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d897e11b-bd07-4077-affa-467aebd81cf4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:25.093382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d897e11b-bd07-4077-affa-467aebd81cf4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:25.099318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d897e11b-bd07-4077-affa-467aebd81cf4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:25.099763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d897e11b-bd07-4077-affa-467aebd81cf4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:25.100518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d897e11b-bd07-4077-affa-467aebd81cf4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:25.100945 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d897e11b-bd07-4077-affa-467aebd81cf4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:25.238188 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d897e11b-bd07-4077-affa-467aebd81cf4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:25.246717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d897e11b-bd07-4077-affa-467aebd81cf4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.157835 Jul 12 13:16:25.247338 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 81/167] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:25 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:25.932104 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1119507665", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:25.987723 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] validate_networks() for None {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:16:26.264403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7ed9171a-333f-4e2b-8808-c94561924c4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:26.265465 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7ed9171a-333f-4e2b-8808-c94561924c4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:26.275269 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ed9171a-333f-4e2b-8808-c94561924c4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:26.275859 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ed9171a-333f-4e2b-8808-c94561924c4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:26.276448 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ed9171a-333f-4e2b-8808-c94561924c4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:26.276867 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7ed9171a-333f-4e2b-8808-c94561924c4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:26.279618 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:16:26.280102 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:16:26.280673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:16:26.281310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:16:26.282090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:16:26.295705 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:26.296157 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:26.297126 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:26.297427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:26.314541 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Getting quotas for project 655ebf95243044139f13f2de6111d54e. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:16:26.318535 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Getting quotas for user 5677720bb55d47158d50c18ced438006 and project 655ebf95243044139f13f2de6111d54e. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:16:26.336498 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:16:26.338707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:16:26.391381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-29eea9a2-4a9c-42ec-aba2-1260bcb198eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.462178 Jul 12 13:16:26.392187 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 87/168] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:16:26.403878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-59e286b1-b24d-441d-ac0c-027802de8b84 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:26.405134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-59e286b1-b24d-441d-ac0c-027802de8b84 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:26.431237 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7ed9171a-333f-4e2b-8808-c94561924c4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:26.444513 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7ed9171a-333f-4e2b-8808-c94561924c4f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.182929 Jul 12 13:16:26.445643 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 82/169] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:26 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:26.470151 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-59e286b1-b24d-441d-ac0c-027802de8b84 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:26.478590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-59e286b1-b24d-441d-ac0c-027802de8b84 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1215 microversion: 2.1 time: 0.080196 Jul 12 13:16:26.479554 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 88/170] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:26 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:27.462121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bbc7da47-ca89-415d-8ff0-bf608d5a7383 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:27.462649 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bbc7da47-ca89-415d-8ff0-bf608d5a7383 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:27.468881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbc7da47-ca89-415d-8ff0-bf608d5a7383 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:27.469337 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbc7da47-ca89-415d-8ff0-bf608d5a7383 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:27.470160 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbc7da47-ca89-415d-8ff0-bf608d5a7383 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:27.470585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbc7da47-ca89-415d-8ff0-bf608d5a7383 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:27.496602 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a6c643d6-e0af-4021-b2fd-9258e96bfb33 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:27.497184 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a6c643d6-e0af-4021-b2fd-9258e96bfb33 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:27.504555 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6c643d6-e0af-4021-b2fd-9258e96bfb33 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:27.504999 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6c643d6-e0af-4021-b2fd-9258e96bfb33 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:27.505810 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6c643d6-e0af-4021-b2fd-9258e96bfb33 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:27.506246 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6c643d6-e0af-4021-b2fd-9258e96bfb33 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:27.573695 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a6c643d6-e0af-4021-b2fd-9258e96bfb33 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:27.582005 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a6c643d6-e0af-4021-b2fd-9258e96bfb33 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1219 microversion: 2.1 time: 0.089616 Jul 12 13:16:27.583294 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 89/171] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:27 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:27.646931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bbc7da47-ca89-415d-8ff0-bf608d5a7383 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:27.655802 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bbc7da47-ca89-415d-8ff0-bf608d5a7383 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.197814 Jul 12 13:16:27.656878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 83/172] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:27 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:28.600622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b6e0d449-4cca-4547-926f-be9d7838e324 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:28.601209 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b6e0d449-4cca-4547-926f-be9d7838e324 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:28.607485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6e0d449-4cca-4547-926f-be9d7838e324 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:28.607988 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6e0d449-4cca-4547-926f-be9d7838e324 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:28.608918 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6e0d449-4cca-4547-926f-be9d7838e324 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:28.609759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6e0d449-4cca-4547-926f-be9d7838e324 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:28.674797 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-027f8023-3ce4-4ccb-89a6-e6db4def143f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:28.676070 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-027f8023-3ce4-4ccb-89a6-e6db4def143f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:28.686780 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b6e0d449-4cca-4547-926f-be9d7838e324 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:28.691892 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-027f8023-3ce4-4ccb-89a6-e6db4def143f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:28.692332 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-027f8023-3ce4-4ccb-89a6-e6db4def143f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:28.693128 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-027f8023-3ce4-4ccb-89a6-e6db4def143f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:28.693554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-027f8023-3ce4-4ccb-89a6-e6db4def143f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:28.706435 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b6e0d449-4cca-4547-926f-be9d7838e324 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1211 microversion: 2.1 time: 0.109731 Jul 12 13:16:28.707309 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 90/173] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:28 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:28.726013 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:28.858730 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-027f8023-3ce4-4ccb-89a6-e6db4def143f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:28.867791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-027f8023-3ce4-4ccb-89a6-e6db4def143f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.198081 Jul 12 13:16:28.868756 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 84/174] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:28 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:28.907403 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4a182b52-f958-445c-b2bb-61e6ea286baf tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:28.908062 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4a182b52-f958-445c-b2bb-61e6ea286baf tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:28.914127 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4a182b52-f958-445c-b2bb-61e6ea286baf tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:28.914569 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4a182b52-f958-445c-b2bb-61e6ea286baf tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:28.915689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4a182b52-f958-445c-b2bb-61e6ea286baf tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:28.916118 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4a182b52-f958-445c-b2bb-61e6ea286baf tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:28.941359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4a182b52-f958-445c-b2bb-61e6ea286baf tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:16:29.024559 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4a182b52-f958-445c-b2bb-61e6ea286baf tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "DELETE /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 204 len: 0 microversion: 2.1 time: 0.121405 Jul 12 13:16:29.025148 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 91/175] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:16:28 2022] DELETE /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:16:29.033440 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c5c1f772-44e3-4050-a2d0-9371271a873e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:29.034062 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c5c1f772-44e3-4050-a2d0-9371271a873e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:29.040348 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5c1f772-44e3-4050-a2d0-9371271a873e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:29.040799 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5c1f772-44e3-4050-a2d0-9371271a873e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:29.041774 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5c1f772-44e3-4050-a2d0-9371271a873e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:29.042207 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5c1f772-44e3-4050-a2d0-9371271a873e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:29.194265 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c5c1f772-44e3-4050-a2d0-9371271a873e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:29.205698 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c5c1f772-44e3-4050-a2d0-9371271a873e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1504 microversion: 2.1 time: 0.176239 Jul 12 13:16:29.206484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 85/176] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:29 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:29.724396 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a709f8fb-5a7b-4d9f-8b73-2cc17cdc9a39 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:29.725079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a709f8fb-5a7b-4d9f-8b73-2cc17cdc9a39 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:29.732128 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a709f8fb-5a7b-4d9f-8b73-2cc17cdc9a39 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:29.732563 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a709f8fb-5a7b-4d9f-8b73-2cc17cdc9a39 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:29.733310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a709f8fb-5a7b-4d9f-8b73-2cc17cdc9a39 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:29.734058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a709f8fb-5a7b-4d9f-8b73-2cc17cdc9a39 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:29.798798 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a709f8fb-5a7b-4d9f-8b73-2cc17cdc9a39 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:29.806764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a709f8fb-5a7b-4d9f-8b73-2cc17cdc9a39 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1275 microversion: 2.1 time: 0.086703 Jul 12 13:16:29.807365 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 92/177] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:29 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:29.885338 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c6fa3fde-cd0f-45f1-b214-1353562209e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:29.885950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c6fa3fde-cd0f-45f1-b214-1353562209e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:29.892946 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6fa3fde-cd0f-45f1-b214-1353562209e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:29.893281 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6fa3fde-cd0f-45f1-b214-1353562209e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:29.894041 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6fa3fde-cd0f-45f1-b214-1353562209e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:29.894448 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c6fa3fde-cd0f-45f1-b214-1353562209e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:30.036072 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c6fa3fde-cd0f-45f1-b214-1353562209e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:30.050069 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c6fa3fde-cd0f-45f1-b214-1353562209e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.168282 Jul 12 13:16:30.050750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 86/178] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:29 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:30.224276 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-997eda16-3455-4f2e-bdda-c1d94f694a03 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:30.224913 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-997eda16-3455-4f2e-bdda-c1d94f694a03 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:30.231688 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-997eda16-3455-4f2e-bdda-c1d94f694a03 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:30.232138 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-997eda16-3455-4f2e-bdda-c1d94f694a03 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:30.232948 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-997eda16-3455-4f2e-bdda-c1d94f694a03 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:30.233357 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-997eda16-3455-4f2e-bdda-c1d94f694a03 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:30.388200 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-997eda16-3455-4f2e-bdda-c1d94f694a03 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:30.397502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-997eda16-3455-4f2e-bdda-c1d94f694a03 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1504 microversion: 2.1 time: 0.177560 Jul 12 13:16:30.398105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 93/179] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:30 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:30.824908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e61aba59-93c1-48d2-bb45-2e687d9ff6b5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:30.825505 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e61aba59-93c1-48d2-bb45-2e687d9ff6b5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:30.832706 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e61aba59-93c1-48d2-bb45-2e687d9ff6b5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:30.833340 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e61aba59-93c1-48d2-bb45-2e687d9ff6b5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:30.834091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e61aba59-93c1-48d2-bb45-2e687d9ff6b5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:30.834510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e61aba59-93c1-48d2-bb45-2e687d9ff6b5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:30.899793 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e61aba59-93c1-48d2-bb45-2e687d9ff6b5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:30.910363 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e61aba59-93c1-48d2-bb45-2e687d9ff6b5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1275 microversion: 2.1 time: 0.089759 Jul 12 13:16:30.910981 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 87/180] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:30 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:31.072794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-707f2537-37c2-4c96-9843-babb8689e122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:31.073602 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-707f2537-37c2-4c96-9843-babb8689e122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:31.080420 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-707f2537-37c2-4c96-9843-babb8689e122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:31.081022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-707f2537-37c2-4c96-9843-babb8689e122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:31.081781 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-707f2537-37c2-4c96-9843-babb8689e122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:31.082206 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-707f2537-37c2-4c96-9843-babb8689e122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:31.240196 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-707f2537-37c2-4c96-9843-babb8689e122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:31.248874 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-707f2537-37c2-4c96-9843-babb8689e122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.180341 Jul 12 13:16:31.249449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 94/181] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:31 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:31.414442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-760f616f-0bd0-459a-a8a5-ad7582e71c48 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:31.415090 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-760f616f-0bd0-459a-a8a5-ad7582e71c48 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:31.428066 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-760f616f-0bd0-459a-a8a5-ad7582e71c48 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:31.428511 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-760f616f-0bd0-459a-a8a5-ad7582e71c48 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:31.429526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-760f616f-0bd0-459a-a8a5-ad7582e71c48 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:31.429874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-760f616f-0bd0-459a-a8a5-ad7582e71c48 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:31.805053 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-760f616f-0bd0-459a-a8a5-ad7582e71c48 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:31.813508 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-760f616f-0bd0-459a-a8a5-ad7582e71c48 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1504 microversion: 2.1 time: 0.403038 Jul 12 13:16:31.814461 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 88/182] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:31 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:31.929195 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e2c0eb31-edbe-4e66-b9f6-2a13c17b06d2 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:31.929966 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e2c0eb31-edbe-4e66-b9f6-2a13c17b06d2 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:31.936506 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e2c0eb31-edbe-4e66-b9f6-2a13c17b06d2 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:31.937000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e2c0eb31-edbe-4e66-b9f6-2a13c17b06d2 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:31.937803 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e2c0eb31-edbe-4e66-b9f6-2a13c17b06d2 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:31.938212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e2c0eb31-edbe-4e66-b9f6-2a13c17b06d2 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:32.008129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e2c0eb31-edbe-4e66-b9f6-2a13c17b06d2 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:32.016187 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e2c0eb31-edbe-4e66-b9f6-2a13c17b06d2 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1273 microversion: 2.1 time: 0.091017 Jul 12 13:16:32.016550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 95/183] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:31 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:32.153009 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-804285d1-28d1-4fbe-ae46-c49b835a0fd6 req-18edf38f-36c1-4a3d-aa29-1bd87c8146cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e690cd-45ab-4f63-bb8c-5f5f0741ce3b", "name": "network-vif-deleted", "tag": "88285b3f-5c4a-496c-9336-249476e237b5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:32.161096 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-804285d1-28d1-4fbe-ae46-c49b835a0fd6 req-18edf38f-36c1-4a3d-aa29-1bd87c8146cc service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:32.161533 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-804285d1-28d1-4fbe-ae46-c49b835a0fd6 req-18edf38f-36c1-4a3d-aa29-1bd87c8146cc service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:32.172819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-804285d1-28d1-4fbe-ae46-c49b835a0fd6 req-18edf38f-36c1-4a3d-aa29-1bd87c8146cc service nova] Creating event network-vif-deleted:88285b3f-5c4a-496c-9336-249476e237b5 for instance 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b on hv-cinder-79760 Jul 12 13:16:32.177647 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-804285d1-28d1-4fbe-ae46-c49b835a0fd6 req-18edf38f-36c1-4a3d-aa29-1bd87c8146cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028418 Jul 12 13:16:32.178226 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 89/184] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:32.265906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2c3559be-d19b-43d3-9cad-6d1801d51406 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:32.266596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2c3559be-d19b-43d3-9cad-6d1801d51406 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:32.273302 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c3559be-d19b-43d3-9cad-6d1801d51406 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:32.273751 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c3559be-d19b-43d3-9cad-6d1801d51406 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:32.274705 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c3559be-d19b-43d3-9cad-6d1801d51406 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:32.274988 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c3559be-d19b-43d3-9cad-6d1801d51406 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:32.417681 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2c3559be-d19b-43d3-9cad-6d1801d51406 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:32.429493 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2c3559be-d19b-43d3-9cad-6d1801d51406 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.167315 Jul 12 13:16:32.430143 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 96/185] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:32 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:32.832598 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-50214346-acb2-4e40-8f18-19180d74ec12 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:32.839232 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-50214346-acb2-4e40-8f18-19180d74ec12 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:32.861600 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50214346-acb2-4e40-8f18-19180d74ec12 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:32.862040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50214346-acb2-4e40-8f18-19180d74ec12 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:32.862812 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50214346-acb2-4e40-8f18-19180d74ec12 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:32.863286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50214346-acb2-4e40-8f18-19180d74ec12 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:32.983619 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-50214346-acb2-4e40-8f18-19180d74ec12 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:32.999156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-50214346-acb2-4e40-8f18-19180d74ec12 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 200 len: 1299 microversion: 2.1 time: 0.170961 Jul 12 13:16:33.004067 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 90/186] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:32 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:33.034530 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d547c319-80ec-4782-ab40-6df0752f7f7d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:33.035237 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d547c319-80ec-4782-ab40-6df0752f7f7d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:33.048785 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d547c319-80ec-4782-ab40-6df0752f7f7d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:33.049283 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d547c319-80ec-4782-ab40-6df0752f7f7d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:33.050384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d547c319-80ec-4782-ab40-6df0752f7f7d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:33.050817 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d547c319-80ec-4782-ab40-6df0752f7f7d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:33.431239 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d547c319-80ec-4782-ab40-6df0752f7f7d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:33.439826 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d547c319-80ec-4782-ab40-6df0752f7f7d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1273 microversion: 2.1 time: 0.410334 Jul 12 13:16:33.440390 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 97/187] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:33 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:33.446364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b3552f4e-e0f8-428d-a399-23beefaf828d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:33.446982 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b3552f4e-e0f8-428d-a399-23beefaf828d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:33.455301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3552f4e-e0f8-428d-a399-23beefaf828d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:33.455994 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3552f4e-e0f8-428d-a399-23beefaf828d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:33.456801 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3552f4e-e0f8-428d-a399-23beefaf828d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:33.457254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3552f4e-e0f8-428d-a399-23beefaf828d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:33.652824 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b3552f4e-e0f8-428d-a399-23beefaf828d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:33.674601 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b3552f4e-e0f8-428d-a399-23beefaf828d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.232256 Jul 12 13:16:33.687082 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 91/188] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:33 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:34.018248 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:34.019373 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:34.022245 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:34.031207 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:34.031663 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:34.033337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:34.034229 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:34.055641 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] HTTP exception thrown: Instance 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b could not be found. Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Request method failure captured: Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b HTTP/1.1 Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXQX111XgZYdvAoN1bU5kT8VPW8j7PKE0ZsAog2CesS7K3dEXyhLXUD1B08g9DXkt49wz0j8TMxLoWoRFiXYXAkGzjZcSokQAgn1PsIPTIv-yy5zsNwh-mHEQrDnwvmv3C9EOBsFPhPd7_KpIHJtpSx_jCeiSFisN7nzOOST7SZpVHs Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: b93feeaa2e7644829dc24cd3c9a34941 Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesActionsTest-963682898 Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:16:34.057765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b93feeaa2e7644829dc24cd3c9a34941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b93feeaa2e7644829dc24cd3c9a34941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b93feeaa2e7644829dc24cd3c9a34941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b93feeaa2e7644829dc24cd3c9a34941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesActionsTest-963682898 Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: b93feeaa2e7644829dc24cd3c9a34941 Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesActionsTest-963682898 Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesActionsTest-963682898-project Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 1524d3b8e0804388b57cccbc4451f73e Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesActionsTest-963682898-project Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b could not be found. Jul 12 13:16:34.059212 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '46e690cd-45ab-4f63-bb8c-5f5f0741ce3b'} Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b could not be found. Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:16:34.060021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b could not be found. Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b could not be found. Jul 12 13:16:34.061264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:34.062319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Returning 404 to user: Instance 46e690cd-45ab-4f63-bb8c-5f5f0741ce3b could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:16:34.062319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-48f2ed85-48dc-46a6-912e-2779d65b5366 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b" status: 404 len: 111 microversion: 2.1 time: 0.046074 Jul 12 13:16:34.062319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 98/189] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:34 2022] GET /compute/v2.1/servers/46e690cd-45ab-4f63-bb8c-5f5f0741ce3b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:16:34.182668 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1331200401", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "networks": [{"uuid": "2ae649db-ee2d-4766-be5a-4fb3219b7196"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:34.248490 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] validate_networks() for [('2ae649db-ee2d-4766-be5a-4fb3219b7196', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:16:34.459621 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c57014a2-2e06-40b9-a59f-396293e7a52d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:34.460145 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c57014a2-2e06-40b9-a59f-396293e7a52d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:34.468738 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c57014a2-2e06-40b9-a59f-396293e7a52d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:34.469757 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c57014a2-2e06-40b9-a59f-396293e7a52d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:34.470660 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c57014a2-2e06-40b9-a59f-396293e7a52d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:34.472251 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c57014a2-2e06-40b9-a59f-396293e7a52d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:34.712603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c57014a2-2e06-40b9-a59f-396293e7a52d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:34.724318 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c57014a2-2e06-40b9-a59f-396293e7a52d tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.269650 Jul 12 13:16:34.725174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 99/190] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:34 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:34.741503 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-f74827d7-5ecf-4cbf-a6d6-b86c47346621 req-466c0534-f0e6-436d-b205-f3df3d5a8af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536", "tag": "bd0ac8ad-eded-4e21-935c-7d9f0c2bce0c"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:34.751711 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-f74827d7-5ecf-4cbf-a6d6-b86c47346621 req-466c0534-f0e6-436d-b205-f3df3d5a8af5 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:34.753076 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-f74827d7-5ecf-4cbf-a6d6-b86c47346621 req-466c0534-f0e6-436d-b205-f3df3d5a8af5 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:34.774500 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-f74827d7-5ecf-4cbf-a6d6-b86c47346621 req-466c0534-f0e6-436d-b205-f3df3d5a8af5 service nova] Creating event network-changed:bd0ac8ad-eded-4e21-935c-7d9f0c2bce0c for instance a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 on hv-cinder-79760 Jul 12 13:16:34.780590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-f74827d7-5ecf-4cbf-a6d6-b86c47346621 req-466c0534-f0e6-436d-b205-f3df3d5a8af5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044548 Jul 12 13:16:34.782124 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 100/191] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:34.787618 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-befd4cdf-e91e-445d-aaa4-b1e8479c8f2c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:34.788326 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-befd4cdf-e91e-445d-aaa4-b1e8479c8f2c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:34.795262 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-befd4cdf-e91e-445d-aaa4-b1e8479c8f2c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:34.795705 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-befd4cdf-e91e-445d-aaa4-b1e8479c8f2c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:34.796475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-befd4cdf-e91e-445d-aaa4-b1e8479c8f2c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:34.797921 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-befd4cdf-e91e-445d-aaa4-b1e8479c8f2c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:34.814633 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:16:34.815242 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:16:34.815854 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:16:34.816266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:16:34.816678 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:16:34.826512 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:34.826977 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:34.827817 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:34.828404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:34.849889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Getting quotas for project b93feeaa2e7644829dc24cd3c9a34941. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:16:34.854143 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Getting quotas for user 1524d3b8e0804388b57cccbc4451f73e and project b93feeaa2e7644829dc24cd3c9a34941. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:16:34.866538 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:16:34.869058 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:16:34.916388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9ec53d68-026f-4a5e-891d-b5d332bcd3e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737974 Jul 12 13:16:34.917041 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 92/192] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:16:34.929259 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7e12212d-b705-450a-aaa6-c800c2ab0e14 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:34.929881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7e12212d-b705-450a-aaa6-c800c2ab0e14 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:34.999057 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-befd4cdf-e91e-445d-aaa4-b1e8479c8f2c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:35.008058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-befd4cdf-e91e-445d-aaa4-b1e8479c8f2c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.224453 Jul 12 13:16:35.011626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7e12212d-b705-450a-aaa6-c800c2ab0e14 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:35.016451 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 101/193] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:34 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:35.020057 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7e12212d-b705-450a-aaa6-c800c2ab0e14 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1214 microversion: 2.1 time: 0.094844 Jul 12 13:16:35.020637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 93/194] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:34 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:35.741390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c7cc45d7-b925-4f3f-8c4f-375ff2aa9ddb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:35.741908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c7cc45d7-b925-4f3f-8c4f-375ff2aa9ddb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:35.747993 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7cc45d7-b925-4f3f-8c4f-375ff2aa9ddb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:35.748444 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7cc45d7-b925-4f3f-8c4f-375ff2aa9ddb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:35.749214 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7cc45d7-b925-4f3f-8c4f-375ff2aa9ddb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:35.749633 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7cc45d7-b925-4f3f-8c4f-375ff2aa9ddb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:35.899274 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c7cc45d7-b925-4f3f-8c4f-375ff2aa9ddb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:35.908716 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c7cc45d7-b925-4f3f-8c4f-375ff2aa9ddb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.171357 Jul 12 13:16:35.909326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 94/195] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:35 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:36.035766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e6c1e9ab-98f1-4907-ad58-5165436e21da tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:36.036484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e6c1e9ab-98f1-4907-ad58-5165436e21da tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:36.037199 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-57d0cf0c-9f99-44d1-a785-941426e0d4e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:36.037857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-57d0cf0c-9f99-44d1-a785-941426e0d4e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:36.044601 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-57d0cf0c-9f99-44d1-a785-941426e0d4e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:36.044745 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e6c1e9ab-98f1-4907-ad58-5165436e21da tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:36.045388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-57d0cf0c-9f99-44d1-a785-941426e0d4e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:36.045722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e6c1e9ab-98f1-4907-ad58-5165436e21da tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:36.046210 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-57d0cf0c-9f99-44d1-a785-941426e0d4e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:36.046637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-57d0cf0c-9f99-44d1-a785-941426e0d4e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:36.046744 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e6c1e9ab-98f1-4907-ad58-5165436e21da tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:36.048136 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e6c1e9ab-98f1-4907-ad58-5165436e21da tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:36.131409 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-57d0cf0c-9f99-44d1-a785-941426e0d4e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:36.138869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-57d0cf0c-9f99-44d1-a785-941426e0d4e6 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1218 microversion: 2.1 time: 0.105684 Jul 12 13:16:36.139480 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 95/196] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:36 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:36.204967 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e6c1e9ab-98f1-4907-ad58-5165436e21da tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:36.217776 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e6c1e9ab-98f1-4907-ad58-5165436e21da tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.188591 Jul 12 13:16:36.218483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 102/197] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:36 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:36.926502 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b75f552d-eebf-4e03-8f56-cdd0a9b7160a tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:36.927867 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b75f552d-eebf-4e03-8f56-cdd0a9b7160a tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:36.935553 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b75f552d-eebf-4e03-8f56-cdd0a9b7160a tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:36.936403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b75f552d-eebf-4e03-8f56-cdd0a9b7160a tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:36.937779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b75f552d-eebf-4e03-8f56-cdd0a9b7160a tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:36.938812 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b75f552d-eebf-4e03-8f56-cdd0a9b7160a tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:37.110324 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b75f552d-eebf-4e03-8f56-cdd0a9b7160a tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:37.118044 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b75f552d-eebf-4e03-8f56-cdd0a9b7160a tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.195395 Jul 12 13:16:37.118614 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 96/198] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:36 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:37.156699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8717010d-504d-47c9-aa4c-e6796a1d26c0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:37.157274 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8717010d-504d-47c9-aa4c-e6796a1d26c0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:37.160565 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:37.161611 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=18 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:37.166379 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8717010d-504d-47c9-aa4c-e6796a1d26c0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:37.166820 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8717010d-504d-47c9-aa4c-e6796a1d26c0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:37.167590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8717010d-504d-47c9-aa4c-e6796a1d26c0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:37.168331 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8717010d-504d-47c9-aa4c-e6796a1d26c0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:37.189031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:37.235673 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e8708224-8fed-4200-bdc9-aaa9c66d6257 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:37.236274 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e8708224-8fed-4200-bdc9-aaa9c66d6257 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:37.242202 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e8708224-8fed-4200-bdc9-aaa9c66d6257 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:37.242635 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e8708224-8fed-4200-bdc9-aaa9c66d6257 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:37.243448 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e8708224-8fed-4200-bdc9-aaa9c66d6257 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:37.243900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e8708224-8fed-4200-bdc9-aaa9c66d6257 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:37.269121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8717010d-504d-47c9-aa4c-e6796a1d26c0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:37.279283 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8717010d-504d-47c9-aa4c-e6796a1d26c0 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1210 microversion: 2.1 time: 0.126378 Jul 12 13:16:37.279867 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 103/199] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:37 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:37.381568 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e8708224-8fed-4200-bdc9-aaa9c66d6257 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:37.389407 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e8708224-8fed-4200-bdc9-aaa9c66d6257 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1520 microversion: 2.1 time: 0.157898 Jul 12 13:16:37.389977 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 97/200] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:37 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:38.135316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-683d4544-b9a0-470a-a9ef-8254a9a02c03 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:38.135926 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-683d4544-b9a0-470a-a9ef-8254a9a02c03 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:38.142385 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-683d4544-b9a0-470a-a9ef-8254a9a02c03 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:38.142991 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-683d4544-b9a0-470a-a9ef-8254a9a02c03 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:38.143718 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-683d4544-b9a0-470a-a9ef-8254a9a02c03 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:38.144142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-683d4544-b9a0-470a-a9ef-8254a9a02c03 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:38.284737 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-683d4544-b9a0-470a-a9ef-8254a9a02c03 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:38.296491 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2eb0cde1-7c25-4e77-a44f-844ce23969bb tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:38.297099 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2eb0cde1-7c25-4e77-a44f-844ce23969bb tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:38.301610 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-683d4544-b9a0-470a-a9ef-8254a9a02c03 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.170054 Jul 12 13:16:38.302168 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 104/201] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:38 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:38.304113 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2eb0cde1-7c25-4e77-a44f-844ce23969bb tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:38.304580 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2eb0cde1-7c25-4e77-a44f-844ce23969bb tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:38.305340 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2eb0cde1-7c25-4e77-a44f-844ce23969bb tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:38.305819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2eb0cde1-7c25-4e77-a44f-844ce23969bb tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:38.380423 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2eb0cde1-7c25-4e77-a44f-844ce23969bb tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:38.390641 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2eb0cde1-7c25-4e77-a44f-844ce23969bb tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1266 microversion: 2.1 time: 0.097216 Jul 12 13:16:38.390641 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 98/202] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:38 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:38.406146 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-19d7cb7b-c763-4b34-b493-71824f4a94d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:38.406779 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-19d7cb7b-c763-4b34-b493-71824f4a94d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:38.420532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19d7cb7b-c763-4b34-b493-71824f4a94d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:38.420987 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19d7cb7b-c763-4b34-b493-71824f4a94d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:38.423472 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19d7cb7b-c763-4b34-b493-71824f4a94d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:38.423943 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19d7cb7b-c763-4b34-b493-71824f4a94d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:38.638304 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-19d7cb7b-c763-4b34-b493-71824f4a94d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:38.649117 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-19d7cb7b-c763-4b34-b493-71824f4a94d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1500 microversion: 2.1 time: 0.245487 Jul 12 13:16:38.650028 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 105/203] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:38 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1500 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:38.674845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7fba548a-8eed-4e7e-b84b-6f5c6b8416dd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:38.675710 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7fba548a-8eed-4e7e-b84b-6f5c6b8416dd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:38.693229 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fba548a-8eed-4e7e-b84b-6f5c6b8416dd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:38.694111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fba548a-8eed-4e7e-b84b-6f5c6b8416dd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:38.695685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fba548a-8eed-4e7e-b84b-6f5c6b8416dd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:38.702002 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fba548a-8eed-4e7e-b84b-6f5c6b8416dd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:38.948896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7fba548a-8eed-4e7e-b84b-6f5c6b8416dd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:38.967896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7fba548a-8eed-4e7e-b84b-6f5c6b8416dd tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1514 microversion: 2.1 time: 0.291003 Jul 12 13:16:38.979777 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 99/204] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:38 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:39.322913 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6467d3f4-5df2-4cb0-9192-a574b7ea3343 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:39.328312 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6467d3f4-5df2-4cb0-9192-a574b7ea3343 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:39.339687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6467d3f4-5df2-4cb0-9192-a574b7ea3343 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:39.341471 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6467d3f4-5df2-4cb0-9192-a574b7ea3343 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:39.343457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6467d3f4-5df2-4cb0-9192-a574b7ea3343 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:39.344972 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6467d3f4-5df2-4cb0-9192-a574b7ea3343 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:39.409524 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-808c2d07-0ec9-4ec5-850a-12ee1eadfb8c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:39.411051 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-808c2d07-0ec9-4ec5-850a-12ee1eadfb8c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:39.419225 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:39.422813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-808c2d07-0ec9-4ec5-850a-12ee1eadfb8c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:39.423454 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-808c2d07-0ec9-4ec5-850a-12ee1eadfb8c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:39.424992 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-808c2d07-0ec9-4ec5-850a-12ee1eadfb8c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:39.425959 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-808c2d07-0ec9-4ec5-850a-12ee1eadfb8c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:39.524142 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-808c2d07-0ec9-4ec5-850a-12ee1eadfb8c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:39.526738 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6467d3f4-5df2-4cb0-9192-a574b7ea3343 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:39.535191 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6467d3f4-5df2-4cb0-9192-a574b7ea3343 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.221358 Jul 12 13:16:39.536244 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 106/205] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:39 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:39.539561 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-808c2d07-0ec9-4ec5-850a-12ee1eadfb8c tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1272 microversion: 2.1 time: 0.133547 Jul 12 13:16:39.540614 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 100/206] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:39 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:40.443773 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-457a021e-78ea-4720-92cf-f526e7205567 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:40.444757 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-457a021e-78ea-4720-92cf-f526e7205567 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:40.451636 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-457a021e-78ea-4720-92cf-f526e7205567 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:40.452073 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-457a021e-78ea-4720-92cf-f526e7205567 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:40.452862 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-457a021e-78ea-4720-92cf-f526e7205567 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:40.453282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-457a021e-78ea-4720-92cf-f526e7205567 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:40.476912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-457a021e-78ea-4720-92cf-f526e7205567 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lazy-loading 'flavor' on Instance uuid 185dde2b-5476-49f7-bf9d-65a6170bbbc7 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:16:40.556066 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-457a021e-78ea-4720-92cf-f526e7205567 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7/action" status: 200 len: 32 microversion: 2.1 time: 0.116507 Jul 12 13:16:40.556804 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 107/207] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:16:40 2022] POST /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:16:40.567432 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f4c2686c-307b-4faa-b3ff-b1e17831df05 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:40.568588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f4c2686c-307b-4faa-b3ff-b1e17831df05 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:40.572600 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-94789ccd-3e52-4c6d-b4c3-06411c334d8a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:40.573286 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-94789ccd-3e52-4c6d-b4c3-06411c334d8a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:40.578370 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4c2686c-307b-4faa-b3ff-b1e17831df05 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:40.579933 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4c2686c-307b-4faa-b3ff-b1e17831df05 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:40.581733 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4c2686c-307b-4faa-b3ff-b1e17831df05 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:40.582454 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4c2686c-307b-4faa-b3ff-b1e17831df05 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:40.583950 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-94789ccd-3e52-4c6d-b4c3-06411c334d8a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:40.584403 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-94789ccd-3e52-4c6d-b4c3-06411c334d8a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:40.585215 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-94789ccd-3e52-4c6d-b4c3-06411c334d8a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:40.585676 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-94789ccd-3e52-4c6d-b4c3-06411c334d8a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:40.791807 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f4c2686c-307b-4faa-b3ff-b1e17831df05 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:40.800473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f4c2686c-307b-4faa-b3ff-b1e17831df05 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.237989 Jul 12 13:16:40.801687 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 101/208] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:40 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:40.806884 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fc9be01f-c603-4a4b-921c-94eff000b5cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:40.807743 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fc9be01f-c603-4a4b-921c-94eff000b5cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:40.819580 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc9be01f-c603-4a4b-921c-94eff000b5cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:40.820562 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc9be01f-c603-4a4b-921c-94eff000b5cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:40.822234 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc9be01f-c603-4a4b-921c-94eff000b5cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:40.822845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fc9be01f-c603-4a4b-921c-94eff000b5cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:40.869419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-94789ccd-3e52-4c6d-b4c3-06411c334d8a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:40.879477 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-94789ccd-3e52-4c6d-b4c3-06411c334d8a tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1314 microversion: 2.1 time: 0.317915 Jul 12 13:16:40.880283 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 108/209] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:40 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:40.890047 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-5f2f3a13-ad73-42d6-81e2-af19fa7c2d07 req-835e19d1-7ce4-4030-9797-25af12d82053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae", "tag": "2ba56d01-24f2-4d4a-ad7f-fc34e36be697"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:40.900314 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-5f2f3a13-ad73-42d6-81e2-af19fa7c2d07 req-835e19d1-7ce4-4030-9797-25af12d82053 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:40.900761 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-5f2f3a13-ad73-42d6-81e2-af19fa7c2d07 req-835e19d1-7ce4-4030-9797-25af12d82053 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:40.916098 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-5f2f3a13-ad73-42d6-81e2-af19fa7c2d07 req-835e19d1-7ce4-4030-9797-25af12d82053 service nova] Creating event network-changed:2ba56d01-24f2-4d4a-ad7f-fc34e36be697 for instance 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae on hv-cinder-79760 Jul 12 13:16:40.922549 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-5f2f3a13-ad73-42d6-81e2-af19fa7c2d07 req-835e19d1-7ce4-4030-9797-25af12d82053 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039315 Jul 12 13:16:40.923930 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 109/210] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:41.036492 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fc9be01f-c603-4a4b-921c-94eff000b5cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:41.047121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fc9be01f-c603-4a4b-921c-94eff000b5cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.244024 Jul 12 13:16:41.051252 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 102/211] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:40 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:41.819912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-21b07e37-4540-40ce-a479-00f725c08e25 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:41.820721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-21b07e37-4540-40ce-a479-00f725c08e25 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:41.828738 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21b07e37-4540-40ce-a479-00f725c08e25 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:41.829349 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21b07e37-4540-40ce-a479-00f725c08e25 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:41.830178 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21b07e37-4540-40ce-a479-00f725c08e25 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:41.830657 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21b07e37-4540-40ce-a479-00f725c08e25 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:41.896533 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e62e1e38-09f3-436e-bfc2-b9c94fc844ba tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:41.897164 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e62e1e38-09f3-436e-bfc2-b9c94fc844ba tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:41.905202 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e62e1e38-09f3-436e-bfc2-b9c94fc844ba tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:41.905202 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e62e1e38-09f3-436e-bfc2-b9c94fc844ba tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:41.906104 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e62e1e38-09f3-436e-bfc2-b9c94fc844ba tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:41.906540 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e62e1e38-09f3-436e-bfc2-b9c94fc844ba tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:41.935839 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:41.992862 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-21b07e37-4540-40ce-a479-00f725c08e25 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:42.000883 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-21b07e37-4540-40ce-a479-00f725c08e25 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.186346 Jul 12 13:16:42.001469 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 110/212] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:41 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:42.067137 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b9cd0776-3ac6-4fce-bf83-326b2021e5a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:42.067848 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b9cd0776-3ac6-4fce-bf83-326b2021e5a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:42.075811 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9cd0776-3ac6-4fce-bf83-326b2021e5a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:42.076398 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9cd0776-3ac6-4fce-bf83-326b2021e5a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:42.077160 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9cd0776-3ac6-4fce-bf83-326b2021e5a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:42.077924 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9cd0776-3ac6-4fce-bf83-326b2021e5a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:42.099754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e62e1e38-09f3-436e-bfc2-b9c94fc844ba tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:42.107733 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e62e1e38-09f3-436e-bfc2-b9c94fc844ba tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1314 microversion: 2.1 time: 0.215204 Jul 12 13:16:42.108465 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 103/213] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:41 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:42.259512 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b9cd0776-3ac6-4fce-bf83-326b2021e5a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:42.268302 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b9cd0776-3ac6-4fce-bf83-326b2021e5a8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.206124 Jul 12 13:16:42.268702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 111/214] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:42 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:43.018504 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9da188e2-0f9d-40f6-b726-8e28515e8db1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:43.019682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9da188e2-0f9d-40f6-b726-8e28515e8db1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:43.027468 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9da188e2-0f9d-40f6-b726-8e28515e8db1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:43.027917 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9da188e2-0f9d-40f6-b726-8e28515e8db1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:43.028707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9da188e2-0f9d-40f6-b726-8e28515e8db1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:43.029126 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9da188e2-0f9d-40f6-b726-8e28515e8db1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:43.127194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3fa44768-dd80-4c94-97ce-75d25b58e179 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:43.127912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3fa44768-dd80-4c94-97ce-75d25b58e179 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:43.134619 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3fa44768-dd80-4c94-97ce-75d25b58e179 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:43.135185 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3fa44768-dd80-4c94-97ce-75d25b58e179 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:43.136033 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3fa44768-dd80-4c94-97ce-75d25b58e179 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:43.136538 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3fa44768-dd80-4c94-97ce-75d25b58e179 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:43.312586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9da188e2-0f9d-40f6-b726-8e28515e8db1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:43.317140 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3fa44768-dd80-4c94-97ce-75d25b58e179 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:43.327164 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9da188e2-0f9d-40f6-b726-8e28515e8db1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.312533 Jul 12 13:16:43.329137 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 104/215] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:43 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:43.336845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9c42a57c-6352-40a6-a819-883e46e0611a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:43.337465 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9c42a57c-6352-40a6-a819-883e46e0611a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:43.341795 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3fa44768-dd80-4c94-97ce-75d25b58e179 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1314 microversion: 2.1 time: 0.219338 Jul 12 13:16:43.342869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 112/216] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:43 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:43.344061 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c42a57c-6352-40a6-a819-883e46e0611a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:43.344998 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c42a57c-6352-40a6-a819-883e46e0611a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:43.345786 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c42a57c-6352-40a6-a819-883e46e0611a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:43.346347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c42a57c-6352-40a6-a819-883e46e0611a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:43.519918 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9c42a57c-6352-40a6-a819-883e46e0611a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:43.528510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9c42a57c-6352-40a6-a819-883e46e0611a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.198077 Jul 12 13:16:43.529879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 105/217] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:43 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:44.313529 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-467955147", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-98640609", "security_groups": [{"name": "tempest-secgroup-smoke-5729510"}], "networks": [{"uuid": "a051d84a-cd1a-4792-8867-2df6fcd77d65"}], "block_device_mapping_v2": [{"uuid": "11307e08-8f34-467b-abfb-a886a47a133b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:44.345581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9c068495-e780-41c3-bab4-54d7436dd951 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:44.346215 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9c068495-e780-41c3-bab4-54d7436dd951 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:44.353325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c068495-e780-41c3-bab4-54d7436dd951 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:44.353960 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c068495-e780-41c3-bab4-54d7436dd951 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:44.354916 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c068495-e780-41c3-bab4-54d7436dd951 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:44.355526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c068495-e780-41c3-bab4-54d7436dd951 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:44.470353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] validate_networks() for [('a051d84a-cd1a-4792-8867-2df6fcd77d65', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:16:44.512750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9c068495-e780-41c3-bab4-54d7436dd951 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:44.524683 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9c068495-e780-41c3-bab4-54d7436dd951 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.183767 Jul 12 13:16:44.525711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 106/218] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:44 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:44.534350 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0c6d7d8b-197b-46ab-a114-b797b2ca6715 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:44.536143 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0c6d7d8b-197b-46ab-a114-b797b2ca6715 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:44.547753 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c6d7d8b-197b-46ab-a114-b797b2ca6715 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:44.547753 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c6d7d8b-197b-46ab-a114-b797b2ca6715 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:44.547753 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c6d7d8b-197b-46ab-a114-b797b2ca6715 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:44.547753 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c6d7d8b-197b-46ab-a114-b797b2ca6715 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:44.748860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0c6d7d8b-197b-46ab-a114-b797b2ca6715 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:44.759186 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0c6d7d8b-197b-46ab-a114-b797b2ca6715 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1314 microversion: 2.1 time: 0.231525 Jul 12 13:16:44.759769 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 107/219] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:44 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:44.768188 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-66311072-c60b-4b1f-b2b9-d22f9dedbd58 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:44.768806 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-66311072-c60b-4b1f-b2b9-d22f9dedbd58 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:44.779761 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66311072-c60b-4b1f-b2b9-d22f9dedbd58 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:44.780652 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66311072-c60b-4b1f-b2b9-d22f9dedbd58 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:44.781983 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66311072-c60b-4b1f-b2b9-d22f9dedbd58 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:44.782641 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66311072-c60b-4b1f-b2b9-d22f9dedbd58 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:44.840169 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:44.942758 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:16:44.943235 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:16:44.944064 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:16:44.944485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:16:44.944898 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:16:44.961619 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:44.962074 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:44.962877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:44.966485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:45.008625 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Getting quotas for project 106ea1b5dcdf45a2a18fc882d8b49782. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:16:45.016846 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=8 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:45.018156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Getting quotas for user e6a2edc70216491fa7e2c4d2e28d050f and project 106ea1b5dcdf45a2a18fc882d8b49782. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:16:45.036676 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-66311072-c60b-4b1f-b2b9-d22f9dedbd58 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:45.047047 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-66311072-c60b-4b1f-b2b9-d22f9dedbd58 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.282469 Jul 12 13:16:45.047720 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 108/220] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:44 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:45.119579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:16:45.122911 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11307e08-8f34-467b-abfb-a886a47a133b',volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:16:45.183741 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-f46c54d9-255d-454c-8951-9f4efaa08f57 req-af2ddc1a-e931-4b40-94c4-5aa72ae5a4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536", "name": "network-vif-plugged", "status": "completed", "tag": "bd0ac8ad-eded-4e21-935c-7d9f0c2bce0c"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:45.200598 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f46c54d9-255d-454c-8951-9f4efaa08f57 req-af2ddc1a-e931-4b40-94c4-5aa72ae5a4d9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:45.201521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f46c54d9-255d-454c-8951-9f4efaa08f57 req-af2ddc1a-e931-4b40-94c4-5aa72ae5a4d9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:45.241268 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-f46c54d9-255d-454c-8951-9f4efaa08f57 req-af2ddc1a-e931-4b40-94c4-5aa72ae5a4d9 service nova] Creating event network-vif-plugged:bd0ac8ad-eded-4e21-935c-7d9f0c2bce0c for instance a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 on hv-cinder-79760 Jul 12 13:16:45.248811 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-f46c54d9-255d-454c-8951-9f4efaa08f57 req-af2ddc1a-e931-4b40-94c4-5aa72ae5a4d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068812 Jul 12 13:16:45.250722 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 109/221] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:45.327336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-17c187e2-ff34-4433-8901-18202c56eb3d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.017775 Jul 12 13:16:45.336381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 113/222] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:16:44 2022] POST /compute/v2.1/servers => generated 403 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:16:45.342902 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5759384f-2dd0-4da7-be41-d078e3500e7c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:45.343931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5759384f-2dd0-4da7-be41-d078e3500e7c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:45.434829 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5759384f-2dd0-4da7-be41-d078e3500e7c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:45.443589 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5759384f-2dd0-4da7-be41-d078e3500e7c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1086 microversion: 2.1 time: 0.106294 Jul 12 13:16:45.444775 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 110/223] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:45 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1086 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:45.543435 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9551275f-714c-4d07-8a40-94235357acbb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:45.544062 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9551275f-714c-4d07-8a40-94235357acbb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:45.551087 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9551275f-714c-4d07-8a40-94235357acbb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:45.551397 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9551275f-714c-4d07-8a40-94235357acbb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:45.552316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9551275f-714c-4d07-8a40-94235357acbb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:45.553311 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9551275f-714c-4d07-8a40-94235357acbb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:45.776284 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-326baf40-aade-4820-befc-18f9ec440695 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:45.777161 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-326baf40-aade-4820-befc-18f9ec440695 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:45.788031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9551275f-714c-4d07-8a40-94235357acbb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:45.794444 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-326baf40-aade-4820-befc-18f9ec440695 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:45.795182 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-326baf40-aade-4820-befc-18f9ec440695 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:45.798399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9551275f-714c-4d07-8a40-94235357acbb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.260213 Jul 12 13:16:45.798991 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-326baf40-aade-4820-befc-18f9ec440695 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:45.800164 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-326baf40-aade-4820-befc-18f9ec440695 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:45.811161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 114/224] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:45 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:46.005225 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-326baf40-aade-4820-befc-18f9ec440695 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:46.019667 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-326baf40-aade-4820-befc-18f9ec440695 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1314 microversion: 2.1 time: 0.247686 Jul 12 13:16:46.023813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 111/225] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:45 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:46.068496 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-03b6a50a-b13f-41db-9c09-484a20a5ea89 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:46.069405 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-03b6a50a-b13f-41db-9c09-484a20a5ea89 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:46.077712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-03b6a50a-b13f-41db-9c09-484a20a5ea89 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:46.078323 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-03b6a50a-b13f-41db-9c09-484a20a5ea89 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:46.079231 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-03b6a50a-b13f-41db-9c09-484a20a5ea89 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:46.079665 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-03b6a50a-b13f-41db-9c09-484a20a5ea89 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:46.323995 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-03b6a50a-b13f-41db-9c09-484a20a5ea89 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:46.334426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-03b6a50a-b13f-41db-9c09-484a20a5ea89 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.274111 Jul 12 13:16:46.335421 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 115/226] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:46 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:46.461330 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e34ed564-8ed0-44f1-abca-b6d1bb684538 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:46.461967 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e34ed564-8ed0-44f1-abca-b6d1bb684538 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:46.469594 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e34ed564-8ed0-44f1-abca-b6d1bb684538 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:46.470249 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e34ed564-8ed0-44f1-abca-b6d1bb684538 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:46.471114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e34ed564-8ed0-44f1-abca-b6d1bb684538 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:46.471698 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e34ed564-8ed0-44f1-abca-b6d1bb684538 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:46.541290 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e34ed564-8ed0-44f1-abca-b6d1bb684538 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:46.551342 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e34ed564-8ed0-44f1-abca-b6d1bb684538 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1136 microversion: 2.1 time: 0.094084 Jul 12 13:16:46.552245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 112/227] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:46 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1136 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:46.817808 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-945d443b-425d-469b-a25c-8bde88f3caeb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:46.818485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-945d443b-425d-469b-a25c-8bde88f3caeb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:46.825253 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-945d443b-425d-469b-a25c-8bde88f3caeb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:46.825672 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-945d443b-425d-469b-a25c-8bde88f3caeb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:46.827026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-945d443b-425d-469b-a25c-8bde88f3caeb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:46.827652 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-945d443b-425d-469b-a25c-8bde88f3caeb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:47.025812 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-945d443b-425d-469b-a25c-8bde88f3caeb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:47.034838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-945d443b-425d-469b-a25c-8bde88f3caeb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1315 microversion: 2.1 time: 0.221675 Jul 12 13:16:47.035608 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 116/228] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:46 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:47.037405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a98de60a-e82d-494c-b998-5199bf5e9dc7 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:47.038009 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a98de60a-e82d-494c-b998-5199bf5e9dc7 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:47.044901 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a98de60a-e82d-494c-b998-5199bf5e9dc7 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:47.046039 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a98de60a-e82d-494c-b998-5199bf5e9dc7 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:47.047837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a98de60a-e82d-494c-b998-5199bf5e9dc7 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:47.048601 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a98de60a-e82d-494c-b998-5199bf5e9dc7 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:47.259512 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a98de60a-e82d-494c-b998-5199bf5e9dc7 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:47.268146 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a98de60a-e82d-494c-b998-5199bf5e9dc7 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1314 microversion: 2.1 time: 0.234490 Jul 12 13:16:47.269475 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 113/229] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:47 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:47.275227 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-1b9ef827-dda3-46f9-a434-c6dd6f809092 req-325a2c94-6776-4380-999e-b03a11f34cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae", "name": "network-vif-plugged", "status": "completed", "tag": "2ba56d01-24f2-4d4a-ad7f-fc34e36be697"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:47.284550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-1b9ef827-dda3-46f9-a434-c6dd6f809092 req-325a2c94-6776-4380-999e-b03a11f34cdc service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:47.285528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-1b9ef827-dda3-46f9-a434-c6dd6f809092 req-325a2c94-6776-4380-999e-b03a11f34cdc service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:47.299626 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-1b9ef827-dda3-46f9-a434-c6dd6f809092 req-325a2c94-6776-4380-999e-b03a11f34cdc service nova] Creating event network-vif-plugged:2ba56d01-24f2-4d4a-ad7f-fc34e36be697 for instance 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae on hv-cinder-79760 Jul 12 13:16:47.305038 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-1b9ef827-dda3-46f9-a434-c6dd6f809092 req-325a2c94-6776-4380-999e-b03a11f34cdc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034158 Jul 12 13:16:47.306400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 117/230] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:16:47.351668 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ffdad33d-c8c9-4f3a-89cf-88b9ef37857b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:47.352932 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ffdad33d-c8c9-4f3a-89cf-88b9ef37857b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:47.360961 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ffdad33d-c8c9-4f3a-89cf-88b9ef37857b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:47.361607 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ffdad33d-c8c9-4f3a-89cf-88b9ef37857b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:47.362488 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ffdad33d-c8c9-4f3a-89cf-88b9ef37857b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:47.363007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ffdad33d-c8c9-4f3a-89cf-88b9ef37857b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:47.517724 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ffdad33d-c8c9-4f3a-89cf-88b9ef37857b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:47.526444 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ffdad33d-c8c9-4f3a-89cf-88b9ef37857b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.178913 Jul 12 13:16:47.527031 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 114/231] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:47 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:47.570550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-332e1316-89cd-4d57-a83f-8d9c5b577e4a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:47.571361 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-332e1316-89cd-4d57-a83f-8d9c5b577e4a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:47.577990 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-332e1316-89cd-4d57-a83f-8d9c5b577e4a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:47.578561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-332e1316-89cd-4d57-a83f-8d9c5b577e4a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:47.580198 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-332e1316-89cd-4d57-a83f-8d9c5b577e4a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:47.580631 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-332e1316-89cd-4d57-a83f-8d9c5b577e4a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:47.658746 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-332e1316-89cd-4d57-a83f-8d9c5b577e4a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:47.668453 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-332e1316-89cd-4d57-a83f-8d9c5b577e4a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1184 microversion: 2.1 time: 0.102980 Jul 12 13:16:47.678334 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 118/232] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:47 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:48.056080 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9d2d420a-85ba-49b8-9f09-5d9b5fc302b9 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:48.057699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9d2d420a-85ba-49b8-9f09-5d9b5fc302b9 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:48.068349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d2d420a-85ba-49b8-9f09-5d9b5fc302b9 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.069296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d2d420a-85ba-49b8-9f09-5d9b5fc302b9 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.070413 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d2d420a-85ba-49b8-9f09-5d9b5fc302b9 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.071413 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d2d420a-85ba-49b8-9f09-5d9b5fc302b9 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.285760 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4898eb5a-86c9-4bb7-96de-7682a7e47087 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:48.286370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4898eb5a-86c9-4bb7-96de-7682a7e47087 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:48.298057 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4898eb5a-86c9-4bb7-96de-7682a7e47087 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.298722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4898eb5a-86c9-4bb7-96de-7682a7e47087 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.300754 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4898eb5a-86c9-4bb7-96de-7682a7e47087 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.302794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4898eb5a-86c9-4bb7-96de-7682a7e47087 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.308572 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9d2d420a-85ba-49b8-9f09-5d9b5fc302b9 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:48.322339 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9d2d420a-85ba-49b8-9f09-5d9b5fc302b9 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1465 microversion: 2.1 time: 0.272929 Jul 12 13:16:48.322992 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 115/233] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:48 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1465 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:48.378210 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-47a35e12-9b3e-446b-9074-3f75d5f8f683 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:48.383516 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-47a35e12-9b3e-446b-9074-3f75d5f8f683 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:48.404340 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-47a35e12-9b3e-446b-9074-3f75d5f8f683 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.404783 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-47a35e12-9b3e-446b-9074-3f75d5f8f683 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.405555 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-47a35e12-9b3e-446b-9074-3f75d5f8f683 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.405972 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-47a35e12-9b3e-446b-9074-3f75d5f8f683 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.524494 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-47a35e12-9b3e-446b-9074-3f75d5f8f683 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:16:48.628683 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4898eb5a-86c9-4bb7-96de-7682a7e47087 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:48.639281 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4898eb5a-86c9-4bb7-96de-7682a7e47087 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1314 microversion: 2.1 time: 0.357937 Jul 12 13:16:48.641902 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 119/234] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:48 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:48.648615 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3d61e701-7a28-4fb4-b43b-8f1f9fa889f0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:48.653354 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3d61e701-7a28-4fb4-b43b-8f1f9fa889f0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:48.665760 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d61e701-7a28-4fb4-b43b-8f1f9fa889f0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.669123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d61e701-7a28-4fb4-b43b-8f1f9fa889f0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.670267 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d61e701-7a28-4fb4-b43b-8f1f9fa889f0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.671552 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d61e701-7a28-4fb4-b43b-8f1f9fa889f0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.679377 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:48.681734 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-47a35e12-9b3e-446b-9074-3f75d5f8f683 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 204 len: 0 microversion: 2.1 time: 0.308308 Jul 12 13:16:48.686417 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 116/235] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:16:48 2022] DELETE /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 13:16:48.689836 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ff2394ef-eb21-42fa-851d-33741f80f4bf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:48.690535 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ff2394ef-eb21-42fa-851d-33741f80f4bf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:48.697291 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff2394ef-eb21-42fa-851d-33741f80f4bf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.697718 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff2394ef-eb21-42fa-851d-33741f80f4bf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.698634 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff2394ef-eb21-42fa-851d-33741f80f4bf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.699222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ff2394ef-eb21-42fa-851d-33741f80f4bf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.819416 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ff2394ef-eb21-42fa-851d-33741f80f4bf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:48.828151 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ff2394ef-eb21-42fa-851d-33741f80f4bf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1202 microversion: 2.1 time: 0.143468 Jul 12 13:16:48.829535 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 117/236] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:48 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1202 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:48.845804 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c626ade2-84a9-4aca-8445-eaef0937e625 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:48.846818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c626ade2-84a9-4aca-8445-eaef0937e625 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:48.859093 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c626ade2-84a9-4aca-8445-eaef0937e625 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.859774 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c626ade2-84a9-4aca-8445-eaef0937e625 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.860815 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c626ade2-84a9-4aca-8445-eaef0937e625 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:48.861544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c626ade2-84a9-4aca-8445-eaef0937e625 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:48.883324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3d61e701-7a28-4fb4-b43b-8f1f9fa889f0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:48.895545 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3d61e701-7a28-4fb4-b43b-8f1f9fa889f0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.252327 Jul 12 13:16:48.896422 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 120/237] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:48 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:49.068108 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c626ade2-84a9-4aca-8445-eaef0937e625 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:49.076958 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c626ade2-84a9-4aca-8445-eaef0937e625 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1471 microversion: 2.1 time: 0.245962 Jul 12 13:16:49.077725 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 118/238] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:48 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:49.657074 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1bb0ecdf-c349-44ea-9e79-54119fd97559 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:49.657827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-1bb0ecdf-c349-44ea-9e79-54119fd97559 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:49.664628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1bb0ecdf-c349-44ea-9e79-54119fd97559 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:49.665064 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1bb0ecdf-c349-44ea-9e79-54119fd97559 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:49.665811 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1bb0ecdf-c349-44ea-9e79-54119fd97559 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:49.666780 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1bb0ecdf-c349-44ea-9e79-54119fd97559 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:49.804538 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-1bb0ecdf-c349-44ea-9e79-54119fd97559 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:49.812323 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-1bb0ecdf-c349-44ea-9e79-54119fd97559 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1314 microversion: 2.1 time: 0.159793 Jul 12 13:16:49.812791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 121/239] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:49 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:49.846534 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-71837782-e824-46d9-bd3e-dd0feeef5dfc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:49.847331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-71837782-e824-46d9-bd3e-dd0feeef5dfc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:49.854019 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71837782-e824-46d9-bd3e-dd0feeef5dfc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:49.854494 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71837782-e824-46d9-bd3e-dd0feeef5dfc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:49.855365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71837782-e824-46d9-bd3e-dd0feeef5dfc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:49.855779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71837782-e824-46d9-bd3e-dd0feeef5dfc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:49.913374 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-34ef9275-44a2-4a61-8cdd-60bbaf069533 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:49.913988 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-34ef9275-44a2-4a61-8cdd-60bbaf069533 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:49.920368 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-34ef9275-44a2-4a61-8cdd-60bbaf069533 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:49.920806 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-34ef9275-44a2-4a61-8cdd-60bbaf069533 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:49.921546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-34ef9275-44a2-4a61-8cdd-60bbaf069533 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:49.921970 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-34ef9275-44a2-4a61-8cdd-60bbaf069533 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:50.054851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-34ef9275-44a2-4a61-8cdd-60bbaf069533 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:50.062065 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-71837782-e824-46d9-bd3e-dd0feeef5dfc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:50.070058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-34ef9275-44a2-4a61-8cdd-60bbaf069533 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.160793 Jul 12 13:16:50.070631 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 122/240] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:49 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:50.071977 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-71837782-e824-46d9-bd3e-dd0feeef5dfc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1267 microversion: 2.1 time: 0.229394 Jul 12 13:16:50.073370 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 119/241] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:49 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:50.097510 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5c0be3af-0386-40cf-be2f-397de49b1bf5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:50.098527 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-5c0be3af-0386-40cf-be2f-397de49b1bf5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:50.105672 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5c0be3af-0386-40cf-be2f-397de49b1bf5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:50.105672 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5c0be3af-0386-40cf-be2f-397de49b1bf5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:50.106336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5c0be3af-0386-40cf-be2f-397de49b1bf5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:50.106769 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5c0be3af-0386-40cf-be2f-397de49b1bf5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:50.211418 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1998807824", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "networks": [{"uuid": "47377c2f-5a61-4c27-a53d-dcba211ccf1b"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:50.264636 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5c0be3af-0386-40cf-be2f-397de49b1bf5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:50.275943 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5c0be3af-0386-40cf-be2f-397de49b1bf5 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1471 microversion: 2.1 time: 0.182602 Jul 12 13:16:50.277112 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 123/242] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:50 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:50.345043 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] validate_networks() for [('47377c2f-5a61-4c27-a53d-dcba211ccf1b', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:16:50.830013 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7ea50ff1-cb04-4a13-818e-d59d3975d5af tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:50.831319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7ea50ff1-cb04-4a13-818e-d59d3975d5af tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:50.838063 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7ea50ff1-cb04-4a13-818e-d59d3975d5af tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:50.838589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7ea50ff1-cb04-4a13-818e-d59d3975d5af tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:50.839632 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7ea50ff1-cb04-4a13-818e-d59d3975d5af tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:50.840306 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7ea50ff1-cb04-4a13-818e-d59d3975d5af tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.043514 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7ea50ff1-cb04-4a13-818e-d59d3975d5af tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:51.054157 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7ea50ff1-cb04-4a13-818e-d59d3975d5af tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1314 microversion: 2.1 time: 0.228762 Jul 12 13:16:51.056763 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 124/243] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:50 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:51.090700 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7a8a15c0-cbaf-4c9c-8426-718a3c474acf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:51.091425 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7a8a15c0-cbaf-4c9c-8426-718a3c474acf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:51.104134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7a8a15c0-cbaf-4c9c-8426-718a3c474acf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:51.104663 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7a8a15c0-cbaf-4c9c-8426-718a3c474acf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.105546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7a8a15c0-cbaf-4c9c-8426-718a3c474acf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:51.109948 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7a8a15c0-cbaf-4c9c-8426-718a3c474acf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.253015 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:16:51.253552 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:16:51.253871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:16:51.254269 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:16:51.254668 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:16:51.273627 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:51.275056 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.276128 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:51.276792 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.288463 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:51.300560 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7a8a15c0-cbaf-4c9c-8426-718a3c474acf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:51.307174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Getting quotas for project f8754507111948849d7294602bff56b6. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:16:51.312401 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7a8a15c0-cbaf-4c9c-8426-718a3c474acf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.226307 Jul 12 13:16:51.314511 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Getting quotas for user 37f5a6fae8c9412da7dc2f2c9c5d2069 and project f8754507111948849d7294602bff56b6. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:16:51.323696 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 125/244] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:51 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:51.329945 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:16:51.330255 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1fe7f7bc-6b26-4599-a9f2-54461b37ee1e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:51.331667 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-1fe7f7bc-6b26-4599-a9f2-54461b37ee1e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:51.332484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:16:51.340282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1fe7f7bc-6b26-4599-a9f2-54461b37ee1e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:51.341022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1fe7f7bc-6b26-4599-a9f2-54461b37ee1e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.342218 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1fe7f7bc-6b26-4599-a9f2-54461b37ee1e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:51.343163 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1fe7f7bc-6b26-4599-a9f2-54461b37ee1e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.411275 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-281cbfe9-b10a-4883-a0d9-b4d3fe52f73e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.204696 Jul 12 13:16:51.412560 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 120/245] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 13:16:51.418226 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6e592855-377b-4878-ab4d-e7cecb3ea8d1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:51.419114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6e592855-377b-4878-ab4d-e7cecb3ea8d1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:51.426830 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e592855-377b-4878-ab4d-e7cecb3ea8d1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:51.427678 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e592855-377b-4878-ab4d-e7cecb3ea8d1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.429432 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e592855-377b-4878-ab4d-e7cecb3ea8d1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:51.430044 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e592855-377b-4878-ab4d-e7cecb3ea8d1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.541633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-1fe7f7bc-6b26-4599-a9f2-54461b37ee1e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:51.551245 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-1fe7f7bc-6b26-4599-a9f2-54461b37ee1e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1267 microversion: 2.1 time: 0.226136 Jul 12 13:16:51.552715 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 126/246] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:51 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:51.558353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f9be49f7-de51-445c-ad27-9066ee43d41f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:51.559010 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f9be49f7-de51-445c-ad27-9066ee43d41f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:51.640666 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f9be49f7-de51-445c-ad27-9066ee43d41f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:51.650634 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f9be49f7-de51-445c-ad27-9066ee43d41f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1219 microversion: 2.1 time: 0.096742 Jul 12 13:16:51.650823 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6e592855-377b-4878-ab4d-e7cecb3ea8d1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:51.651992 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 127/247] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:51 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:51.658787 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6e592855-377b-4878-ab4d-e7cecb3ea8d1 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1471 microversion: 2.1 time: 0.244959 Jul 12 13:16:51.668976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 121/248] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:51 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:51.669808 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-e1ae5f5c-89e9-48a7-bf3b-7b62d95629bf req-929baf4f-c9c0-4fca-9bed-01cd833b8d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1b8589-d954-4806-9228-47ea80451712", "tag": "22d70302-4120-482b-8c1c-525d7d7ba7f4"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:51.681124 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-e1ae5f5c-89e9-48a7-bf3b-7b62d95629bf req-929baf4f-c9c0-4fca-9bed-01cd833b8d20 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:51.681568 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-e1ae5f5c-89e9-48a7-bf3b-7b62d95629bf req-929baf4f-c9c0-4fca-9bed-01cd833b8d20 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:51.693341 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-e1ae5f5c-89e9-48a7-bf3b-7b62d95629bf req-929baf4f-c9c0-4fca-9bed-01cd833b8d20 service nova] Creating event network-changed:22d70302-4120-482b-8c1c-525d7d7ba7f4 for instance 5c1b8589-d954-4806-9228-47ea80451712 on hv-cinder-79760 Jul 12 13:16:51.699123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-e1ae5f5c-89e9-48a7-bf3b-7b62d95629bf req-929baf4f-c9c0-4fca-9bed-01cd833b8d20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045381 Jul 12 13:16:51.700417 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 128/249] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:52.073832 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cfb43599-7631-417c-9cd7-7b358260b8ac tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:52.075008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cfb43599-7631-417c-9cd7-7b358260b8ac tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:52.081968 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb43599-7631-417c-9cd7-7b358260b8ac tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.087024 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb43599-7631-417c-9cd7-7b358260b8ac tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.088103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb43599-7631-417c-9cd7-7b358260b8ac tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.090896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfb43599-7631-417c-9cd7-7b358260b8ac tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.332083 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c50df0ec-732b-42c3-af79-a95e56eec47c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:52.332810 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c50df0ec-732b-42c3-af79-a95e56eec47c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:52.348297 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c50df0ec-732b-42c3-af79-a95e56eec47c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.350840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c50df0ec-732b-42c3-af79-a95e56eec47c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.351918 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c50df0ec-732b-42c3-af79-a95e56eec47c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.354821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c50df0ec-732b-42c3-af79-a95e56eec47c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.362464 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cfb43599-7631-417c-9cd7-7b358260b8ac tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:52.373120 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cfb43599-7631-417c-9cd7-7b358260b8ac tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1498 microversion: 2.1 time: 0.303493 Jul 12 13:16:52.373713 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 122/250] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:52 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1498 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:52.399289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-e60a1042-fd41-4080-8e20-287847b727c1 req-26788a71-6367-4709-a1dc-a57d23bf4828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536", "name": "network-vif-deleted", "tag": "bd0ac8ad-eded-4e21-935c-7d9f0c2bce0c"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:52.423301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-e60a1042-fd41-4080-8e20-287847b727c1 req-26788a71-6367-4709-a1dc-a57d23bf4828 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.431895 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-e60a1042-fd41-4080-8e20-287847b727c1 req-26788a71-6367-4709-a1dc-a57d23bf4828 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.452899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-e60a1042-fd41-4080-8e20-287847b727c1 req-26788a71-6367-4709-a1dc-a57d23bf4828 service nova] Creating event network-vif-deleted:bd0ac8ad-eded-4e21-935c-7d9f0c2bce0c for instance a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 on hv-cinder-79760 Jul 12 13:16:52.461700 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-e60a1042-fd41-4080-8e20-287847b727c1 req-26788a71-6367-4709-a1dc-a57d23bf4828 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086817 Jul 12 13:16:52.462302 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 123/251] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:52.559308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c50df0ec-732b-42c3-af79-a95e56eec47c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:52.569297 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c50df0ec-732b-42c3-af79-a95e56eec47c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.242828 Jul 12 13:16:52.570390 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 129/252] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:52 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:52.586018 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5c952965-b1ba-4efd-a7e7-020da6ed1676 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:52.589101 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5c952965-b1ba-4efd-a7e7-020da6ed1676 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:52.598936 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c952965-b1ba-4efd-a7e7-020da6ed1676 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.599438 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c952965-b1ba-4efd-a7e7-020da6ed1676 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.601075 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c952965-b1ba-4efd-a7e7-020da6ed1676 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.601675 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5c952965-b1ba-4efd-a7e7-020da6ed1676 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.670414 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a750232e-3925-48c1-a31b-84aa9f3d1cbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:52.671889 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a750232e-3925-48c1-a31b-84aa9f3d1cbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:52.680627 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a750232e-3925-48c1-a31b-84aa9f3d1cbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.682728 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a750232e-3925-48c1-a31b-84aa9f3d1cbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.684360 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a750232e-3925-48c1-a31b-84aa9f3d1cbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.685930 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a750232e-3925-48c1-a31b-84aa9f3d1cbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.769800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a750232e-3925-48c1-a31b-84aa9f3d1cbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:52.776090 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5c952965-b1ba-4efd-a7e7-020da6ed1676 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:52.779483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a750232e-3925-48c1-a31b-84aa9f3d1cbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1271 microversion: 2.1 time: 0.114443 Jul 12 13:16:52.791431 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 130/253] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:52 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:52.791725 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5c952965-b1ba-4efd-a7e7-020da6ed1676 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.226051 Jul 12 13:16:52.792348 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 124/254] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:52 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:52.808628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b72a9736-71be-420a-9085-f4db7cb8e367 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:52.809269 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b72a9736-71be-420a-9085-f4db7cb8e367 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:52.816622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b72a9736-71be-420a-9085-f4db7cb8e367 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.817068 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b72a9736-71be-420a-9085-f4db7cb8e367 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.818586 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b72a9736-71be-420a-9085-f4db7cb8e367 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:52.819017 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b72a9736-71be-420a-9085-f4db7cb8e367 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:52.888464 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b72a9736-71be-420a-9085-f4db7cb8e367 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:52.896753 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b72a9736-71be-420a-9085-f4db7cb8e367 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1300 microversion: 2.1 time: 0.104229 Jul 12 13:16:52.897335 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 131/255] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:52 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:53.088730 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2bfb93ba-11e1-4074-9419-611c41d77bb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:53.089237 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2bfb93ba-11e1-4074-9419-611c41d77bb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:53.096460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2bfb93ba-11e1-4074-9419-611c41d77bb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.096899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2bfb93ba-11e1-4074-9419-611c41d77bb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.097675 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2bfb93ba-11e1-4074-9419-611c41d77bb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.098106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2bfb93ba-11e1-4074-9419-611c41d77bb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.129552 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2bfb93ba-11e1-4074-9419-611c41d77bb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/ips" status: 200 len: 153 microversion: 2.20 time: 0.044797 Jul 12 13:16:53.130437 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 125/256] 10.222.0.33 () {60 vars in 1288 bytes} [Tue Jul 12 13:16:53 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/ips => generated 153 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:16:53.348261 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-21617f20-af4a-4126-ace3-e4d028bf9e54 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:53.348800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-21617f20-af4a-4126-ace3-e4d028bf9e54 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:53.357621 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21617f20-af4a-4126-ace3-e4d028bf9e54 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.358109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21617f20-af4a-4126-ace3-e4d028bf9e54 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.358905 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21617f20-af4a-4126-ace3-e4d028bf9e54 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.359404 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21617f20-af4a-4126-ace3-e4d028bf9e54 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.386923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-21617f20-af4a-4126-ace3-e4d028bf9e54 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:16:53.482193 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-21617f20-af4a-4126-ace3-e4d028bf9e54 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 204 len: 0 microversion: 2.1 time: 0.137567 Jul 12 13:16:53.483129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 132/257] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:16:53 2022] DELETE /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 13:16:53.494276 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-953f00db-c549-43ba-8238-ba2c884953c8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:53.495542 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-953f00db-c549-43ba-8238-ba2c884953c8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:53.503443 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-953f00db-c549-43ba-8238-ba2c884953c8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.504137 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-953f00db-c549-43ba-8238-ba2c884953c8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.505054 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-953f00db-c549-43ba-8238-ba2c884953c8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.505620 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-953f00db-c549-43ba-8238-ba2c884953c8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.590278 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-29eed48f-7af8-4bac-ab52-c10b1f879c35 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:53.591098 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-29eed48f-7af8-4bac-ab52-c10b1f879c35 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:53.597844 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29eed48f-7af8-4bac-ab52-c10b1f879c35 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.598412 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29eed48f-7af8-4bac-ab52-c10b1f879c35 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.599225 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29eed48f-7af8-4bac-ab52-c10b1f879c35 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.599717 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29eed48f-7af8-4bac-ab52-c10b1f879c35 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.707837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-953f00db-c549-43ba-8238-ba2c884953c8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:53.715710 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-953f00db-c549-43ba-8238-ba2c884953c8 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1504 microversion: 2.1 time: 0.228301 Jul 12 13:16:53.716406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 126/258] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:53 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:53.743513 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-29eed48f-7af8-4bac-ab52-c10b1f879c35 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:53.751421 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-29eed48f-7af8-4bac-ab52-c10b1f879c35 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.165118 Jul 12 13:16:53.752012 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 133/259] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:53 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:53.798288 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-eb00b00c-67fd-4924-964c-f9beff9d899e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:53.798898 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-eb00b00c-67fd-4924-964c-f9beff9d899e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:53.805257 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb00b00c-67fd-4924-964c-f9beff9d899e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.805703 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb00b00c-67fd-4924-964c-f9beff9d899e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.806461 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb00b00c-67fd-4924-964c-f9beff9d899e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.808138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb00b00c-67fd-4924-964c-f9beff9d899e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.813739 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6b285d30-1735-4b73-b7e9-f77920561bcb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:53.814352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6b285d30-1735-4b73-b7e9-f77920561bcb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:53.821610 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b285d30-1735-4b73-b7e9-f77920561bcb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.822048 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b285d30-1735-4b73-b7e9-f77920561bcb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.828919 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b285d30-1735-4b73-b7e9-f77920561bcb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.829358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b285d30-1735-4b73-b7e9-f77920561bcb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.886225 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-eb00b00c-67fd-4924-964c-f9beff9d899e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:53.904538 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-eb00b00c-67fd-4924-964c-f9beff9d899e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1277 microversion: 2.1 time: 0.110290 Jul 12 13:16:53.905139 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 127/260] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:53 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:53.919417 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:53.920027 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:53.926944 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.927431 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.928204 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.928629 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.967564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:53.968229 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:53.969271 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lazy-loading 'fault' on Instance uuid a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:16:54.046431 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5677720bb55d47158d50c18ced438006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655ebf95243044139f13f2de6111d54e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:54.057634 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-66685cf2-0221-49bb-847f-7edbc79112eb tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 200 len: 1305 microversion: 2.1 time: 0.142324 Jul 12 13:16:54.058250 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 128/261] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:53 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 1305 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:54.278568 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6b285d30-1735-4b73-b7e9-f77920561bcb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:54.287284 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6b285d30-1735-4b73-b7e9-f77920561bcb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.477713 Jul 12 13:16:54.287864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 134/262] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:53 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:54.735838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7388958d-82db-45c5-9247-27c8006653c3 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:54.736390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7388958d-82db-45c5-9247-27c8006653c3 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:54.742769 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7388958d-82db-45c5-9247-27c8006653c3 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:54.743251 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7388958d-82db-45c5-9247-27c8006653c3 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:54.744010 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7388958d-82db-45c5-9247-27c8006653c3 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:54.744446 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7388958d-82db-45c5-9247-27c8006653c3 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:54.769797 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cdbd4c54-f921-41d0-bdfd-4d955ff1dff5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:54.770899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cdbd4c54-f921-41d0-bdfd-4d955ff1dff5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:54.780777 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdbd4c54-f921-41d0-bdfd-4d955ff1dff5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:54.781948 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdbd4c54-f921-41d0-bdfd-4d955ff1dff5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:54.783232 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdbd4c54-f921-41d0-bdfd-4d955ff1dff5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:54.784066 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdbd4c54-f921-41d0-bdfd-4d955ff1dff5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:54.879858 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7388958d-82db-45c5-9247-27c8006653c3 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:54.887639 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7388958d-82db-45c5-9247-27c8006653c3 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1504 microversion: 2.1 time: 0.156832 Jul 12 13:16:54.888218 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 129/263] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:54 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:54.922101 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-716e65fd-05f3-48aa-9f72-c05ae74d753e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:54.922715 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-716e65fd-05f3-48aa-9f72-c05ae74d753e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:54.928685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-716e65fd-05f3-48aa-9f72-c05ae74d753e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:54.929115 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-cdbd4c54-f921-41d0-bdfd-4d955ff1dff5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:54.929233 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-716e65fd-05f3-48aa-9f72-c05ae74d753e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:54.929865 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-716e65fd-05f3-48aa-9f72-c05ae74d753e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:54.930285 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-716e65fd-05f3-48aa-9f72-c05ae74d753e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:54.937773 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cdbd4c54-f921-41d0-bdfd-4d955ff1dff5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.173080 Jul 12 13:16:54.938359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 135/264] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:54 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:55.069183 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-75cf29ac-34cd-417a-ad2f-40789c8f5d98 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:55.070051 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-75cf29ac-34cd-417a-ad2f-40789c8f5d98 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:55.072373 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:55.073559 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:55.081145 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75cf29ac-34cd-417a-ad2f-40789c8f5d98 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.081591 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75cf29ac-34cd-417a-ad2f-40789c8f5d98 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:55.082606 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75cf29ac-34cd-417a-ad2f-40789c8f5d98 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.083199 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75cf29ac-34cd-417a-ad2f-40789c8f5d98 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:55.111835 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-75cf29ac-34cd-417a-ad2f-40789c8f5d98 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/ips" status: 200 len: 149 microversion: 2.1 time: 0.047090 Jul 12 13:16:55.112685 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 136/265] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:16:55 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:55.123470 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:55.124080 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] [instance: a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:55.130655 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.131132 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:55.131895 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.132321 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:55.136935 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:55.140666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-716e65fd-05f3-48aa-9f72-c05ae74d753e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:55.148331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-716e65fd-05f3-48aa-9f72-c05ae74d753e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.230544 Jul 12 13:16:55.149390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 130/266] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:54 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:55.164402 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] HTTP exception thrown: Instance a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 could not be found. Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Request method failure captured: Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 HTTP/1.1 Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXQnkl0No6RfvzHL90PtvKAGshyqvIFRpibFTeJw790KXLlwR-t6qSE_dbHrFYU2iTlMBz41NBg62a92xc6mEWXNA7kKv3tdnDJz_cLUCCLQJStCcHGwe0rwmMdAEhhXGI1VuMgQSOJi1RMy61FL9oOxKsJ_VUDmY1mA1Qz0je-sf9k Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 655ebf95243044139f13f2de6111d54e Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesNegativeTest-536843279 Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:16:55.164888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/655ebf95243044139f13f2de6111d54e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_655ebf95243044139f13f2de6111d54e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/655ebf95243044139f13f2de6111d54e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/655ebf95243044139f13f2de6111d54e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesNegativeTest-536843279 Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 655ebf95243044139f13f2de6111d54e Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesNegativeTest-536843279 Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesNegativeTest-536843279-project Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 5677720bb55d47158d50c18ced438006 Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesNegativeTest-536843279-project Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 could not be found. Jul 12 13:16:55.166375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': 'a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536'} Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 could not be found. Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:16:55.167270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 could not be found. Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 could not be found. Jul 12 13:16:55.169090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:55.170929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] Returning 404 to user: Instance a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:16:55.170929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ae6179bb-4749-4840-b220-bdfc9cdb6f21 tempest-VolumesNegativeTest-536843279 tempest-VolumesNegativeTest-536843279-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536" status: 404 len: 111 microversion: 2.1 time: 0.050398 Jul 12 13:16:55.170929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 137/267] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:55 2022] GET /compute/v2.1/servers/a0e3a40e-d8e7-4fb9-8f2c-07a8bf44e536 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:16:55.306746 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f37374ca-49e1-40c2-8f28-31bf74b46162 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:55.309139 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f37374ca-49e1-40c2-8f28-31bf74b46162 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:55.317339 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f37374ca-49e1-40c2-8f28-31bf74b46162 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.317873 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f37374ca-49e1-40c2-8f28-31bf74b46162 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:55.319015 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f37374ca-49e1-40c2-8f28-31bf74b46162 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.319602 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f37374ca-49e1-40c2-8f28-31bf74b46162 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:55.682034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f37374ca-49e1-40c2-8f28-31bf74b46162 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:55.693940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f37374ca-49e1-40c2-8f28-31bf74b46162 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.392305 Jul 12 13:16:55.705919 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 131/268] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:55 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:55.905367 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-46efd9bb-05cf-4d07-ab5f-2b5bd1df8e4f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:55.905968 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-46efd9bb-05cf-4d07-ab5f-2b5bd1df8e4f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:55.913833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-46efd9bb-05cf-4d07-ab5f-2b5bd1df8e4f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.914282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-46efd9bb-05cf-4d07-ab5f-2b5bd1df8e4f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:55.915083 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-46efd9bb-05cf-4d07-ab5f-2b5bd1df8e4f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.915513 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-46efd9bb-05cf-4d07-ab5f-2b5bd1df8e4f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:55.954891 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-39c504b2-dd9d-4ca6-9e4c-8b53e340c750 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:55.957084 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-39c504b2-dd9d-4ca6-9e4c-8b53e340c750 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:55.964191 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-39c504b2-dd9d-4ca6-9e4c-8b53e340c750 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.964965 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-39c504b2-dd9d-4ca6-9e4c-8b53e340c750 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:55.966149 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-39c504b2-dd9d-4ca6-9e4c-8b53e340c750 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:55.968428 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-39c504b2-dd9d-4ca6-9e4c-8b53e340c750 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.069608 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-46efd9bb-05cf-4d07-ab5f-2b5bd1df8e4f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:56.079249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-46efd9bb-05cf-4d07-ab5f-2b5bd1df8e4f tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1504 microversion: 2.1 time: 0.177924 Jul 12 13:16:56.079939 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 138/269] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:55 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:56.165282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-337cc642-e5c9-4cdf-8520-236547c9167f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:56.165757 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-337cc642-e5c9-4cdf-8520-236547c9167f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:56.173347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-337cc642-e5c9-4cdf-8520-236547c9167f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.173788 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-337cc642-e5c9-4cdf-8520-236547c9167f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.174843 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-337cc642-e5c9-4cdf-8520-236547c9167f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.175825 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-337cc642-e5c9-4cdf-8520-236547c9167f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.343163 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-337cc642-e5c9-4cdf-8520-236547c9167f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:56.353124 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-337cc642-e5c9-4cdf-8520-236547c9167f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.192042 Jul 12 13:16:56.353716 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 139/270] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:56 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:56.358451 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-bab88edd-f104-4bc8-a3a5-c464f75f433c req-da2a4465-3405-4bef-aa9e-aeab6f983aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa0d215-6475-4c82-9e86-901a21c75155", "tag": "d3c7813f-d3b4-43bd-8dbc-1de1569546c5"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:56.367881 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-bab88edd-f104-4bc8-a3a5-c464f75f433c req-da2a4465-3405-4bef-aa9e-aeab6f983aa8 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.368319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-bab88edd-f104-4bc8-a3a5-c464f75f433c req-da2a4465-3405-4bef-aa9e-aeab6f983aa8 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.380805 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-bab88edd-f104-4bc8-a3a5-c464f75f433c req-da2a4465-3405-4bef-aa9e-aeab6f983aa8 service nova] Creating event network-changed:d3c7813f-d3b4-43bd-8dbc-1de1569546c5 for instance bfa0d215-6475-4c82-9e86-901a21c75155 on hv-cinder-79760 Jul 12 13:16:56.385965 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-bab88edd-f104-4bc8-a3a5-c464f75f433c req-da2a4465-3405-4bef-aa9e-aeab6f983aa8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030845 Jul 12 13:16:56.386799 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 140/271] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:56.395185 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7bac33c2-83bf-44e0-bd2a-e4eb3ea21f3f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:56.395998 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7bac33c2-83bf-44e0-bd2a-e4eb3ea21f3f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:56.403881 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7bac33c2-83bf-44e0-bd2a-e4eb3ea21f3f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.404459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7bac33c2-83bf-44e0-bd2a-e4eb3ea21f3f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.405554 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7bac33c2-83bf-44e0-bd2a-e4eb3ea21f3f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.405993 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7bac33c2-83bf-44e0-bd2a-e4eb3ea21f3f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.431338 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-7bac33c2-83bf-44e0-bd2a-e4eb3ea21f3f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lazy-loading 'flavor' on Instance uuid 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:16:56.616174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-39c504b2-dd9d-4ca6-9e4c-8b53e340c750 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:56.625764 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-39c504b2-dd9d-4ca6-9e4c-8b53e340c750 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.674702 Jul 12 13:16:56.635953 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 132/272] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:55 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:56.641105 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6707e6cc-47e7-4a32-85e0-27ae43aa7060 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "349c2e3e-954e-40fc-808f-ce9f48c811a8"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:56.642302 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6707e6cc-47e7-4a32-85e0-27ae43aa7060 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:56.650313 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6707e6cc-47e7-4a32-85e0-27ae43aa7060 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.651587 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6707e6cc-47e7-4a32-85e0-27ae43aa7060 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.652838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6707e6cc-47e7-4a32-85e0-27ae43aa7060 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.653994 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6707e6cc-47e7-4a32-85e0-27ae43aa7060 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.745764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7bac33c2-83bf-44e0-bd2a-e4eb3ea21f3f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/action" status: 202 len: 0 microversion: 2.20 time: 0.357651 Jul 12 13:16:56.746401 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 141/273] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 12 13:16:56 2022] POST /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:16:56.763925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ad6699f6-1b43-4240-8396-87de5987cf46 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:56.764797 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ad6699f6-1b43-4240-8396-87de5987cf46 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:56.775684 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad6699f6-1b43-4240-8396-87de5987cf46 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.776106 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad6699f6-1b43-4240-8396-87de5987cf46 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.777574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad6699f6-1b43-4240-8396-87de5987cf46 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.783547 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad6699f6-1b43-4240-8396-87de5987cf46 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.963424 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ad6699f6-1b43-4240-8396-87de5987cf46 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:56.977124 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ad6699f6-1b43-4240-8396-87de5987cf46 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.228654 Jul 12 13:16:56.978861 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 142/274] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:56 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:56.984396 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:56.984989 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:56.994710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.996019 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:56.996839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:56.997980 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:57.224945 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:57.239085 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6707e6cc-47e7-4a32-85e0-27ae43aa7060 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601776 Jul 12 13:16:57.244087 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 133/275] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:16:56 2022] POST /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 194 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:57.250027 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:57.250806 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:57.261228 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:57.263790 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:57.265030 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:57.265417 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:57.267869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:57.275327 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:57.277811 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-95746dc7-7ed2-4ff5-a830-2aeb73c300fd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.296602 Jul 12 13:16:57.278986 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 143/276] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:16:56 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:16:57.322794 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:57.323348 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:57.323852 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lazy-loading 'fault' on Instance uuid 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:16:57.370334 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d778ccd0-b7a2-4cad-a307-912a7f158b01 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:57.370939 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d778ccd0-b7a2-4cad-a307-912a7f158b01 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:57.375628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:57.378399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d778ccd0-b7a2-4cad-a307-912a7f158b01 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:57.380969 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d778ccd0-b7a2-4cad-a307-912a7f158b01 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:57.382302 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d778ccd0-b7a2-4cad-a307-912a7f158b01 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:57.382881 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d778ccd0-b7a2-4cad-a307-912a7f158b01 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:57.384344 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-22bfddb5-4a5c-4a20-957b-94cf72741198 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1304 microversion: 2.1 time: 0.143209 Jul 12 13:16:57.384927 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 134/277] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:57 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:57.541642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d778ccd0-b7a2-4cad-a307-912a7f158b01 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:57.557445 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d778ccd0-b7a2-4cad-a307-912a7f158b01 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.191586 Jul 12 13:16:57.558466 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 144/278] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:57 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:57.650530 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-958c0554-fe26-47de-8bdd-8860a94b9f7a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:57.651301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-958c0554-fe26-47de-8bdd-8860a94b9f7a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:57.660347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-958c0554-fe26-47de-8bdd-8860a94b9f7a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:57.661063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-958c0554-fe26-47de-8bdd-8860a94b9f7a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:57.662409 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-958c0554-fe26-47de-8bdd-8860a94b9f7a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:57.663116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-958c0554-fe26-47de-8bdd-8860a94b9f7a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:57.808526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-958c0554-fe26-47de-8bdd-8860a94b9f7a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:57.816469 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-958c0554-fe26-47de-8bdd-8860a94b9f7a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.172494 Jul 12 13:16:57.817037 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 135/279] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:57 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:57.995204 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-dee580df-0824-47b1-9bde-8ba52e263324 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:57.995805 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-dee580df-0824-47b1-9bde-8ba52e263324 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:58.002820 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dee580df-0824-47b1-9bde-8ba52e263324 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.003286 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dee580df-0824-47b1-9bde-8ba52e263324 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.004036 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dee580df-0824-47b1-9bde-8ba52e263324 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.004448 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dee580df-0824-47b1-9bde-8ba52e263324 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.148089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-dee580df-0824-47b1-9bde-8ba52e263324 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:58.155874 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-dee580df-0824-47b1-9bde-8ba52e263324 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.164489 Jul 12 13:16:58.156599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 145/280] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:57 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:58.297754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:58.298350 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:58.305391 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.305820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.306562 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.306986 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.327259 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:58.402935 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:58.403767 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:58.410163 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.410685 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.411547 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.412091 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.447808 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:58.450179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.450524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.450934 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lazy-loading 'fault' on Instance uuid 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:16:58.457506 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:58.459009 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:58.460170 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-48dd0b3d-04d9-4410-9ba6-2733005ebe63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.166372 Jul 12 13:16:58.460945 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 136/281] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:16:58 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:16:58.504927 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1524d3b8e0804388b57cccbc4451f73e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93feeaa2e7644829dc24cd3c9a34941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:58.512598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a6effca5-d57e-4e11-8db7-ab1e9fce13a5 tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 200 len: 1304 microversion: 2.1 time: 0.114987 Jul 12 13:16:58.514755 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 146/282] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:58 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:58.558018 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-bf7a0257-02c5-4197-ba18-b1c40d7756e4 req-b32d4731-9b43-4bbe-b15d-be1b6eaafe6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae", "name": "network-vif-deleted", "tag": "2ba56d01-24f2-4d4a-ad7f-fc34e36be697"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:16:58.561460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:16:58.569022 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-bf7a0257-02c5-4197-ba18-b1c40d7756e4 req-b32d4731-9b43-4bbe-b15d-be1b6eaafe6e service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.569454 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-bf7a0257-02c5-4197-ba18-b1c40d7756e4 req-b32d4731-9b43-4bbe-b15d-be1b6eaafe6e service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.573689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9cb894a4-a753-421d-ac01-3534a35b563e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:58.574402 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9cb894a4-a753-421d-ac01-3534a35b563e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:58.583635 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9cb894a4-a753-421d-ac01-3534a35b563e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.585136 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9cb894a4-a753-421d-ac01-3534a35b563e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.587937 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9cb894a4-a753-421d-ac01-3534a35b563e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.589847 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9cb894a4-a753-421d-ac01-3534a35b563e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.739003 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-bf7a0257-02c5-4197-ba18-b1c40d7756e4 req-b32d4731-9b43-4bbe-b15d-be1b6eaafe6e service nova] Creating event network-vif-deleted:2ba56d01-24f2-4d4a-ad7f-fc34e36be697 for instance 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae on hv-cinder-79760 Jul 12 13:16:58.744422 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-bf7a0257-02c5-4197-ba18-b1c40d7756e4 req-b32d4731-9b43-4bbe-b15d-be1b6eaafe6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189846 Jul 12 13:16:58.745562 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 137/283] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:16:58.781638 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9cb894a4-a753-421d-ac01-3534a35b563e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:58.790903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9cb894a4-a753-421d-ac01-3534a35b563e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.221077 Jul 12 13:16:58.809799 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 147/284] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:58 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:58.833718 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f61f0122-ce53-43dc-8e9e-6a88e5673203 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:58.834522 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f61f0122-ce53-43dc-8e9e-6a88e5673203 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:58.846305 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f61f0122-ce53-43dc-8e9e-6a88e5673203 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.847128 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f61f0122-ce53-43dc-8e9e-6a88e5673203 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:58.848172 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f61f0122-ce53-43dc-8e9e-6a88e5673203 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:58.848783 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f61f0122-ce53-43dc-8e9e-6a88e5673203 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:59.083091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f61f0122-ce53-43dc-8e9e-6a88e5673203 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:59.091035 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f61f0122-ce53-43dc-8e9e-6a88e5673203 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.261758 Jul 12 13:16:59.091601 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 138/285] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:58 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:16:59.174373 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a9f5934f-cc7c-4766-9891-f8943d70a69e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:59.175168 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a9f5934f-cc7c-4766-9891-f8943d70a69e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:59.181982 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a9f5934f-cc7c-4766-9891-f8943d70a69e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:59.182492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a9f5934f-cc7c-4766-9891-f8943d70a69e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:59.183265 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a9f5934f-cc7c-4766-9891-f8943d70a69e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:59.183847 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a9f5934f-cc7c-4766-9891-f8943d70a69e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:59.326145 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a9f5934f-cc7c-4766-9891-f8943d70a69e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:59.334149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a9f5934f-cc7c-4766-9891-f8943d70a69e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.164548 Jul 12 13:16:59.334697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 148/286] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:59 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:16:59.481533 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:59.482067 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:59.490816 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:59.491336 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:59.492257 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:59.492817 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:59.532128 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:59.532728 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] [instance: 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:59.539611 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:59.540045 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:59.540801 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:59.541223 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:59.555352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] HTTP exception thrown: Instance 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae could not be found. Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Request method failure captured: Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae HTTP/1.1 Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXQX111XgZYdvAoN1bU5kT8VPW8j7PKE0ZsAog2CesS7K3dEXyhLXUD1B08g9DXkt49wz0j8TMxLoWoRFiXYXAkGzjZcSokQAgn1PsIPTIv-yy5zsNwh-mHEQrDnwvmv3C9EOBsFPhPd7_KpIHJtpSx_jCeiSFisN7nzOOST7SZpVHs Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: b93feeaa2e7644829dc24cd3c9a34941 Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesActionsTest-963682898 Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:16:59.557022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b93feeaa2e7644829dc24cd3c9a34941"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b93feeaa2e7644829dc24cd3c9a34941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b93feeaa2e7644829dc24cd3c9a34941"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b93feeaa2e7644829dc24cd3c9a34941"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesActionsTest-963682898 Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: b93feeaa2e7644829dc24cd3c9a34941 Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesActionsTest-963682898 Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesActionsTest-963682898-project Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 1524d3b8e0804388b57cccbc4451f73e Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesActionsTest-963682898-project Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae could not be found. Jul 12 13:16:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae'} Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae could not be found. Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:16:59.559483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae could not be found. Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae could not be found. Jul 12 13:16:59.560802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:16:59.562005 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] Returning 404 to user: Instance 8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:16:59.562005 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-512e8089-e47c-4d0f-a17c-6e8fcd48f15e tempest-VolumesActionsTest-963682898 tempest-VolumesActionsTest-963682898-project] 10.222.0.33 "GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae" status: 404 len: 111 microversion: 2.1 time: 0.030313 Jul 12 13:16:59.562005 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 149/287] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:59 2022] GET /compute/v2.1/servers/8a18ee26-d8be-4a0d-b5af-4d5c6552c6ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:16:59.642410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:59.662037 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:59.663699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:16:59.665012 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-72bc1046-820c-49f2-89e0-4954fa0e1227 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.189765 Jul 12 13:16:59.665668 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 139/288] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:16:59 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:16:59.811956 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-807cd765-05c9-465f-8e08-0977d29ce36f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:16:59.811956 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-807cd765-05c9-465f-8e08-0977d29ce36f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:16:59.817694 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-807cd765-05c9-465f-8e08-0977d29ce36f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:59.818129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-807cd765-05c9-465f-8e08-0977d29ce36f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:59.818884 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-807cd765-05c9-465f-8e08-0977d29ce36f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:16:59.819333 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-807cd765-05c9-465f-8e08-0977d29ce36f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:16:59.999753 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-807cd765-05c9-465f-8e08-0977d29ce36f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:00.009113 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-807cd765-05c9-465f-8e08-0977d29ce36f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.202850 Jul 12 13:17:00.009803 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 150/289] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:16:59 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:00.111684 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-56801ca0-0177-4609-ae91-1df056a6a2bf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:00.112756 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-56801ca0-0177-4609-ae91-1df056a6a2bf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:00.120808 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-56801ca0-0177-4609-ae91-1df056a6a2bf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:00.121393 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-56801ca0-0177-4609-ae91-1df056a6a2bf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:00.122671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-56801ca0-0177-4609-ae91-1df056a6a2bf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:00.123122 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-56801ca0-0177-4609-ae91-1df056a6a2bf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:00.284867 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-56801ca0-0177-4609-ae91-1df056a6a2bf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:00.292993 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-56801ca0-0177-4609-ae91-1df056a6a2bf tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.188318 Jul 12 13:17:00.293572 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 140/290] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:00 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:00.350821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2a4b369e-d247-4e7d-b00d-2c764a0636b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:00.351648 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2a4b369e-d247-4e7d-b00d-2c764a0636b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:00.358442 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2a4b369e-d247-4e7d-b00d-2c764a0636b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:00.358927 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2a4b369e-d247-4e7d-b00d-2c764a0636b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:00.359851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2a4b369e-d247-4e7d-b00d-2c764a0636b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:00.360445 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2a4b369e-d247-4e7d-b00d-2c764a0636b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:00.592241 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2a4b369e-d247-4e7d-b00d-2c764a0636b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:00.602791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2a4b369e-d247-4e7d-b00d-2c764a0636b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.255830 Jul 12 13:17:00.603420 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 151/291] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:00 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:00.685397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:00.686137 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:00.695175 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:00.695808 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:00.697261 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:00.698027 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:00.881825 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:00.890634 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:00.892281 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:00.893509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dfe0fddb-5961-47aa-93c7-cecbf9221f03 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.212646 Jul 12 13:17:00.894058 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 141/292] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:00 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:01.030262 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6564d13b-f6de-4226-bfc3-90c9af3440ff tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:01.030988 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6564d13b-f6de-4226-bfc3-90c9af3440ff tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:01.037909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6564d13b-f6de-4226-bfc3-90c9af3440ff tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:01.038358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6564d13b-f6de-4226-bfc3-90c9af3440ff tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:01.039145 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6564d13b-f6de-4226-bfc3-90c9af3440ff tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:01.039575 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6564d13b-f6de-4226-bfc3-90c9af3440ff tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:01.188868 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6564d13b-f6de-4226-bfc3-90c9af3440ff tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:01.200157 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6564d13b-f6de-4226-bfc3-90c9af3440ff tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.176017 Jul 12 13:17:01.201018 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 152/293] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:01 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:01.314174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-10c71602-be95-4d85-9ddd-4bfbc4ba2968 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:01.314787 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-10c71602-be95-4d85-9ddd-4bfbc4ba2968 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:01.317463 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:01.323360 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10c71602-be95-4d85-9ddd-4bfbc4ba2968 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:01.323801 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10c71602-be95-4d85-9ddd-4bfbc4ba2968 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:01.324860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10c71602-be95-4d85-9ddd-4bfbc4ba2968 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:01.325288 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10c71602-be95-4d85-9ddd-4bfbc4ba2968 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:01.327315 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=8 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:01.462987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-10c71602-be95-4d85-9ddd-4bfbc4ba2968 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:01.473382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-10c71602-be95-4d85-9ddd-4bfbc4ba2968 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.165548 Jul 12 13:17:01.474496 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 142/294] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:01 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:01.619851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e6dd4297-938c-4727-930d-5617f2839421 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:01.620436 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e6dd4297-938c-4727-930d-5617f2839421 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:01.628210 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e6dd4297-938c-4727-930d-5617f2839421 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:01.628644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e6dd4297-938c-4727-930d-5617f2839421 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:01.629393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e6dd4297-938c-4727-930d-5617f2839421 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:01.629824 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e6dd4297-938c-4727-930d-5617f2839421 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:01.646747 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=8 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:01.650425 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:01.775699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e6dd4297-938c-4727-930d-5617f2839421 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:01.785051 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e6dd4297-938c-4727-930d-5617f2839421 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.168822 Jul 12 13:17:01.785784 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 153/295] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:01 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:01.912685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:01.913244 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:01.924358 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:01.924958 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:01.925927 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:01.926373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:02.075189 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:02.085145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:02.086627 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:02.087848 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3d8ffaee-7fa6-4a59-8f58-886d9a1f9207 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.179290 Jul 12 13:17:02.088405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 143/296] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:01 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:02.219910 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-59c93773-2930-4072-a207-316fbe6de099 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:02.220860 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-59c93773-2930-4072-a207-316fbe6de099 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:02.231720 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-59c93773-2930-4072-a207-316fbe6de099 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:02.232418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-59c93773-2930-4072-a207-316fbe6de099 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:02.233637 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-59c93773-2930-4072-a207-316fbe6de099 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:02.234560 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-59c93773-2930-4072-a207-316fbe6de099 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:02.379525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-59c93773-2930-4072-a207-316fbe6de099 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:02.387401 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-59c93773-2930-4072-a207-316fbe6de099 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.173465 Jul 12 13:17:02.387970 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 154/297] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:02 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:02.490926 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c0a07631-36e5-40d0-acae-1d7cba3d8b2b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:02.491502 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c0a07631-36e5-40d0-acae-1d7cba3d8b2b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:02.497848 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c0a07631-36e5-40d0-acae-1d7cba3d8b2b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:02.498294 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c0a07631-36e5-40d0-acae-1d7cba3d8b2b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:02.499068 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c0a07631-36e5-40d0-acae-1d7cba3d8b2b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:02.499493 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c0a07631-36e5-40d0-acae-1d7cba3d8b2b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:02.641174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c0a07631-36e5-40d0-acae-1d7cba3d8b2b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:02.648901 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c0a07631-36e5-40d0-acae-1d7cba3d8b2b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.162337 Jul 12 13:17:02.649474 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 144/298] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:02 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:02.805186 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-26d81ac9-8dc1-4a05-9fbc-535fe784de00 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:02.805820 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-26d81ac9-8dc1-4a05-9fbc-535fe784de00 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:02.813859 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-26d81ac9-8dc1-4a05-9fbc-535fe784de00 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:02.814407 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-26d81ac9-8dc1-4a05-9fbc-535fe784de00 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:02.815326 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-26d81ac9-8dc1-4a05-9fbc-535fe784de00 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:02.815811 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-26d81ac9-8dc1-4a05-9fbc-535fe784de00 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:02.953870 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-26d81ac9-8dc1-4a05-9fbc-535fe784de00 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:02.962403 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-26d81ac9-8dc1-4a05-9fbc-535fe784de00 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.161224 Jul 12 13:17:02.962992 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 155/299] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:02 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:03.106776 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:03.107399 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:03.114692 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:03.115166 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:03.115987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:03.116380 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:03.248810 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:03.257253 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:03.258758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:03.259946 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-28d23908-ef5e-4bb4-abc0-8f183ccfaa5d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.157169 Jul 12 13:17:03.260511 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 145/300] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:03 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:03.407278 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-748a96f0-8503-4fb7-9bd0-f1218c47d699 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:03.407896 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-748a96f0-8503-4fb7-9bd0-f1218c47d699 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:03.414041 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-748a96f0-8503-4fb7-9bd0-f1218c47d699 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:03.414482 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-748a96f0-8503-4fb7-9bd0-f1218c47d699 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:03.415340 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-748a96f0-8503-4fb7-9bd0-f1218c47d699 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:03.415747 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-748a96f0-8503-4fb7-9bd0-f1218c47d699 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:03.555021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-748a96f0-8503-4fb7-9bd0-f1218c47d699 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:03.564232 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-748a96f0-8503-4fb7-9bd0-f1218c47d699 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.161222 Jul 12 13:17:03.564802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 156/301] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:03 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:03.669614 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4b4082d3-1a0b-4301-b591-3298babc865f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:03.670127 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4b4082d3-1a0b-4301-b591-3298babc865f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:03.676701 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b4082d3-1a0b-4301-b591-3298babc865f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:03.677115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b4082d3-1a0b-4301-b591-3298babc865f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:03.677879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b4082d3-1a0b-4301-b591-3298babc865f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:03.678319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4b4082d3-1a0b-4301-b591-3298babc865f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:03.820399 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4b4082d3-1a0b-4301-b591-3298babc865f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:03.828795 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4b4082d3-1a0b-4301-b591-3298babc865f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.163312 Jul 12 13:17:03.829361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 146/302] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:03 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:03.983951 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e89f8395-daf1-48f0-9352-ef0292357806 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:03.985136 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e89f8395-daf1-48f0-9352-ef0292357806 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:03.992435 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e89f8395-daf1-48f0-9352-ef0292357806 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:03.992872 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e89f8395-daf1-48f0-9352-ef0292357806 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:03.993660 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e89f8395-daf1-48f0-9352-ef0292357806 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:03.994087 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e89f8395-daf1-48f0-9352-ef0292357806 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:04.150712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e89f8395-daf1-48f0-9352-ef0292357806 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:04.159754 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e89f8395-daf1-48f0-9352-ef0292357806 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.179934 Jul 12 13:17:04.160520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 157/303] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:03 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:04.277985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:04.278720 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:04.285854 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:04.286287 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:04.287122 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:04.287531 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:04.454651 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:04.462815 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:04.464442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:04.465599 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3c93f209-04b4-4f4d-bdf1-4b92d5534735 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.191606 Jul 12 13:17:04.466126 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 147/304] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:04 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:04.592941 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-476e9179-d280-47fc-8b55-6664f951db36 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:04.594089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-476e9179-d280-47fc-8b55-6664f951db36 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:04.600967 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-476e9179-d280-47fc-8b55-6664f951db36 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:04.601814 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-476e9179-d280-47fc-8b55-6664f951db36 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:04.602791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-476e9179-d280-47fc-8b55-6664f951db36 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:04.603282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-476e9179-d280-47fc-8b55-6664f951db36 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:04.748820 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-476e9179-d280-47fc-8b55-6664f951db36 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:04.757357 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-476e9179-d280-47fc-8b55-6664f951db36 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.168583 Jul 12 13:17:04.757958 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 158/305] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:04 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:04.845864 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a4b0e2e1-9a73-4a8a-b946-bfb094b5a140 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:04.846937 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a4b0e2e1-9a73-4a8a-b946-bfb094b5a140 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:04.853231 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2e1-9a73-4a8a-b946-bfb094b5a140 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:04.854157 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2e1-9a73-4a8a-b946-bfb094b5a140 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:04.854936 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2e1-9a73-4a8a-b946-bfb094b5a140 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:04.855420 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2e1-9a73-4a8a-b946-bfb094b5a140 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:05.016525 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a4b0e2e1-9a73-4a8a-b946-bfb094b5a140 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:05.024789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a4b0e2e1-9a73-4a8a-b946-bfb094b5a140 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.182985 Jul 12 13:17:05.025366 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 148/306] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:04 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:05.179108 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4ec93e10-e0a9-42dc-9efc-ec61eff786fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:05.180091 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4ec93e10-e0a9-42dc-9efc-ec61eff786fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:05.190089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ec93e10-e0a9-42dc-9efc-ec61eff786fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:05.190650 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ec93e10-e0a9-42dc-9efc-ec61eff786fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:05.191843 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ec93e10-e0a9-42dc-9efc-ec61eff786fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:05.192744 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ec93e10-e0a9-42dc-9efc-ec61eff786fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:05.397097 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4ec93e10-e0a9-42dc-9efc-ec61eff786fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:05.405279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4ec93e10-e0a9-42dc-9efc-ec61eff786fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.231027 Jul 12 13:17:05.420763 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 159/307] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:05 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:05.488146 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:05.492273 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:05.510430 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:05.510890 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:05.511799 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:05.512899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:05.776147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2a4cd69f-ac6a-4bc4-aa39-3583e9e3455a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:05.777036 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2a4cd69f-ac6a-4bc4-aa39-3583e9e3455a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:05.794843 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2a4cd69f-ac6a-4bc4-aa39-3583e9e3455a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:05.795334 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2a4cd69f-ac6a-4bc4-aa39-3583e9e3455a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:05.796125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2a4cd69f-ac6a-4bc4-aa39-3583e9e3455a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:05.796597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2a4cd69f-ac6a-4bc4-aa39-3583e9e3455a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:05.927864 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:05.938359 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:05.940034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:05.941270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-76d0ca40-ef47-4981-90e5-20565f49aaf5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.457077 Jul 12 13:17:05.941827 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 149/308] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:05 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:05.963985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-12018d9c-7a55-478f-9853-6fe070aa3fdc req-55fb5307-519c-465b-b1c2-bfade51efa69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa0d215-6475-4c82-9e86-901a21c75155", "name": "network-vif-plugged", "status": "completed", "tag": "d3c7813f-d3b4-43bd-8dbc-1de1569546c5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:05.978263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-12018d9c-7a55-478f-9853-6fe070aa3fdc req-55fb5307-519c-465b-b1c2-bfade51efa69 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:05.978704 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-12018d9c-7a55-478f-9853-6fe070aa3fdc req-55fb5307-519c-465b-b1c2-bfade51efa69 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:06.000695 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-12018d9c-7a55-478f-9853-6fe070aa3fdc req-55fb5307-519c-465b-b1c2-bfade51efa69 service nova] Creating event network-vif-plugged:d3c7813f-d3b4-43bd-8dbc-1de1569546c5 for instance bfa0d215-6475-4c82-9e86-901a21c75155 on hv-cinder-79760 Jul 12 13:17:06.007164 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-12018d9c-7a55-478f-9853-6fe070aa3fdc req-55fb5307-519c-465b-b1c2-bfade51efa69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059225 Jul 12 13:17:06.008962 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 150/309] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:06.051161 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-aa2aa8fe-ffa3-4a02-a83b-0f21494a0d10 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:06.052172 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-aa2aa8fe-ffa3-4a02-a83b-0f21494a0d10 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:06.068263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aa2aa8fe-ffa3-4a02-a83b-0f21494a0d10 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:06.069656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aa2aa8fe-ffa3-4a02-a83b-0f21494a0d10 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:06.070812 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aa2aa8fe-ffa3-4a02-a83b-0f21494a0d10 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:06.071592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-aa2aa8fe-ffa3-4a02-a83b-0f21494a0d10 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:06.110670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2a4cd69f-ac6a-4bc4-aa39-3583e9e3455a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:06.118048 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2a4cd69f-ac6a-4bc4-aa39-3583e9e3455a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.345732 Jul 12 13:17:06.120741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 160/310] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:05 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:06.400945 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-aa2aa8fe-ffa3-4a02-a83b-0f21494a0d10 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:06.409219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-aa2aa8fe-ffa3-4a02-a83b-0f21494a0d10 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.371206 Jul 12 13:17:06.409896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 151/311] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:06 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:06.429197 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b02cd233-4eec-4d6e-8ad7-7d9d47638adf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:06.429964 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b02cd233-4eec-4d6e-8ad7-7d9d47638adf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:06.441032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b02cd233-4eec-4d6e-8ad7-7d9d47638adf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:06.445597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b02cd233-4eec-4d6e-8ad7-7d9d47638adf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:06.446589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b02cd233-4eec-4d6e-8ad7-7d9d47638adf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:06.447208 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b02cd233-4eec-4d6e-8ad7-7d9d47638adf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:06.693032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b02cd233-4eec-4d6e-8ad7-7d9d47638adf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:06.701950 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b02cd233-4eec-4d6e-8ad7-7d9d47638adf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.277267 Jul 12 13:17:06.704633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 161/312] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:06 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:06.963073 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:06.964307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:06.974121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:06.974914 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:06.976068 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:06.976719 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:07.137783 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d5b1b8d1-7f42-4f2f-8a2a-b16899951f35 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:07.138558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d5b1b8d1-7f42-4f2f-8a2a-b16899951f35 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:07.149422 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d5b1b8d1-7f42-4f2f-8a2a-b16899951f35 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:07.159131 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d5b1b8d1-7f42-4f2f-8a2a-b16899951f35 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:07.164861 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d5b1b8d1-7f42-4f2f-8a2a-b16899951f35 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:07.165388 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d5b1b8d1-7f42-4f2f-8a2a-b16899951f35 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:07.397539 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d5b1b8d1-7f42-4f2f-8a2a-b16899951f35 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:07.403276 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:07.405642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d5b1b8d1-7f42-4f2f-8a2a-b16899951f35 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.272249 Jul 12 13:17:07.407169 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 162/313] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:07 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:07.426120 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:07.427853 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:07.430045 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c57a11ec-50f1-4509-81cc-4ed89d62e327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:07.430902 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c57a11ec-50f1-4509-81cc-4ed89d62e327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:07.437899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c57a11ec-50f1-4509-81cc-4ed89d62e327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:07.439233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c57a11ec-50f1-4509-81cc-4ed89d62e327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:07.440391 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c57a11ec-50f1-4509-81cc-4ed89d62e327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:07.440990 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c57a11ec-50f1-4509-81cc-4ed89d62e327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:07.445183 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-45031161-7859-4da3-8862-15cff18f64b8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.486572 Jul 12 13:17:07.446045 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 152/314] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:06 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:07.662530 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c57a11ec-50f1-4509-81cc-4ed89d62e327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:07.674724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c57a11ec-50f1-4509-81cc-4ed89d62e327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.251650 Jul 12 13:17:07.676724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 163/315] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:07 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:07.723459 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b0a4b1e3-559a-4e59-afd5-30d66ac80f79 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:07.724381 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b0a4b1e3-559a-4e59-afd5-30d66ac80f79 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:07.747545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0a4b1e3-559a-4e59-afd5-30d66ac80f79 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:07.749037 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0a4b1e3-559a-4e59-afd5-30d66ac80f79 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:07.753716 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0a4b1e3-559a-4e59-afd5-30d66ac80f79 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:07.754361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0a4b1e3-559a-4e59-afd5-30d66ac80f79 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:07.961802 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b0a4b1e3-559a-4e59-afd5-30d66ac80f79 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:07.977772 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b0a4b1e3-559a-4e59-afd5-30d66ac80f79 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.260608 Jul 12 13:17:07.979036 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 153/316] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:07 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:08.024852 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-6541d8bb-87ab-4bc0-a12e-b36f91622f9c req-c8235068-3f29-4894-b987-d2edf79a69c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1b8589-d954-4806-9228-47ea80451712", "name": "network-vif-plugged", "status": "completed", "tag": "22d70302-4120-482b-8c1c-525d7d7ba7f4"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:08.033642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-6541d8bb-87ab-4bc0-a12e-b36f91622f9c req-c8235068-3f29-4894-b987-d2edf79a69c7 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:08.034290 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-6541d8bb-87ab-4bc0-a12e-b36f91622f9c req-c8235068-3f29-4894-b987-d2edf79a69c7 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:08.050550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-6541d8bb-87ab-4bc0-a12e-b36f91622f9c req-c8235068-3f29-4894-b987-d2edf79a69c7 service nova] Creating event network-vif-plugged:22d70302-4120-482b-8c1c-525d7d7ba7f4 for instance 5c1b8589-d954-4806-9228-47ea80451712 on hv-cinder-79760 Jul 12 13:17:08.055600 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-6541d8bb-87ab-4bc0-a12e-b36f91622f9c req-c8235068-3f29-4894-b987-d2edf79a69c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034472 Jul 12 13:17:08.056732 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 164/317] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:08.331411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5a573021-de4c-46b8-bf5b-108dc333c8f5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: .version_select at 0x7fd48d4244c0>, body: {"keypair": {"name": "tempest-keypair-1276987071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvtSpDOrvzSpxqYkl1czgqxxCckDP7Ib5Eecsxv08KlsPsSMMIwh6elRYAryV/tOKlGwi7xbcVLzolPDvY/bUxaRd65JHZWMSs/QHbkVG7QBlmMeqZiDGWBuuqJhRKrpA=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:08.347332 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-5a573021-de4c-46b8-bf5b-108dc333c8f5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:17:08.352001 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-5a573021-de4c-46b8-bf5b-108dc333c8f5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for user c8380cfce8114b609c8f0cbf9d445049 and project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:17:08.380236 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5a573021-de4c-46b8-bf5b-108dc333c8f5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052832 Jul 12 13:17:08.381803 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 154/318] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:17:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:08.424879 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-161d8e1e-c5cd-4815-8887-31bd590cc0aa tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:08.426128 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-161d8e1e-c5cd-4815-8887-31bd590cc0aa tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:08.440998 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-161d8e1e-c5cd-4815-8887-31bd590cc0aa tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:08.442236 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-161d8e1e-c5cd-4815-8887-31bd590cc0aa tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:08.443374 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-161d8e1e-c5cd-4815-8887-31bd590cc0aa tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:08.444047 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-161d8e1e-c5cd-4815-8887-31bd590cc0aa tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:08.463890 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:08.464508 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:08.475580 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:08.476030 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:08.476865 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:08.477293 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:08.515964 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:08.660752 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-161d8e1e-c5cd-4815-8887-31bd590cc0aa tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:08.684064 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-161d8e1e-c5cd-4815-8887-31bd590cc0aa tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.263427 Jul 12 13:17:08.697807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 165/319] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:08 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:08.703615 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-04000eec-0d50-46ea-be0a-aa38c5c04087 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:08.704470 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-04000eec-0d50-46ea-be0a-aa38c5c04087 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:08.713249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04000eec-0d50-46ea-be0a-aa38c5c04087 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:08.713539 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04000eec-0d50-46ea-be0a-aa38c5c04087 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:08.714439 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04000eec-0d50-46ea-be0a-aa38c5c04087 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:08.715143 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04000eec-0d50-46ea-be0a-aa38c5c04087 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:08.801985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:08.813273 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:08.820370 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:08.825751 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9ea9fb61-cae3-4936-8020-243914d53f2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.362657 Jul 12 13:17:08.828060 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 155/320] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:08 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:08.999356 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-66faf6a4-8038-4f60-8c53-3adf29638322 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:09.000818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-66faf6a4-8038-4f60-8c53-3adf29638322 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:09.023441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-04000eec-0d50-46ea-be0a-aa38c5c04087 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:09.033869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66faf6a4-8038-4f60-8c53-3adf29638322 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:09.034303 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66faf6a4-8038-4f60-8c53-3adf29638322 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:09.039446 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66faf6a4-8038-4f60-8c53-3adf29638322 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:09.043054 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66faf6a4-8038-4f60-8c53-3adf29638322 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:09.043468 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-04000eec-0d50-46ea-be0a-aa38c5c04087 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.343220 Jul 12 13:17:09.044322 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 166/321] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:08 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:09.312066 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-66faf6a4-8038-4f60-8c53-3adf29638322 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:09.371484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-66faf6a4-8038-4f60-8c53-3adf29638322 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.371799 Jul 12 13:17:09.372509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 156/322] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:08 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:09.709755 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b1533168-7be4-4e48-a1f0-86c02de81f3e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:09.710369 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b1533168-7be4-4e48-a1f0-86c02de81f3e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:09.726090 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b1533168-7be4-4e48-a1f0-86c02de81f3e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:09.726521 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b1533168-7be4-4e48-a1f0-86c02de81f3e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:09.727362 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b1533168-7be4-4e48-a1f0-86c02de81f3e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:09.727843 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b1533168-7be4-4e48-a1f0-86c02de81f3e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:09.844520 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:09.849139 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:09.858174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:09.869313 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:09.870427 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:09.871061 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:09.988452 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b1533168-7be4-4e48-a1f0-86c02de81f3e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:10.001029 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b1533168-7be4-4e48-a1f0-86c02de81f3e tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1319 microversion: 2.1 time: 0.300718 Jul 12 13:17:10.015866 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 167/323] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:09 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:10.061011 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9a50d31a-5cb4-4ec9-ac1e-af736d43ce36 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:10.061785 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9a50d31a-5cb4-4ec9-ac1e-af736d43ce36 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:10.076905 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9a50d31a-5cb4-4ec9-ac1e-af736d43ce36 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.077658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9a50d31a-5cb4-4ec9-ac1e-af736d43ce36 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.079014 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9a50d31a-5cb4-4ec9-ac1e-af736d43ce36 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.079834 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9a50d31a-5cb4-4ec9-ac1e-af736d43ce36 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.091366 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:10.106189 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:10.107738 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:10.108969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a8821f96-f94f-4139-8f58-7285d1d34445 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.268708 Jul 12 13:17:10.109608 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 157/324] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:09 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:10.346587 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9a50d31a-5cb4-4ec9-ac1e-af736d43ce36 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:10.356583 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9a50d31a-5cb4-4ec9-ac1e-af736d43ce36 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1500 microversion: 2.1 time: 0.299379 Jul 12 13:17:10.357383 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 168/325] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:10 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1500 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:10.376155 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11012cc8-6d51-4a95-ab2d-c94f9e42dc7c"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:10.378023 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:10.385606 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.386853 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.387985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.388429 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.395760 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-302bb4c4-0d6f-4daf-ada4-6bcf1898318c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:10.396811 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-302bb4c4-0d6f-4daf-ada4-6bcf1898318c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:10.405746 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-302bb4c4-0d6f-4daf-ada4-6bcf1898318c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.408597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-302bb4c4-0d6f-4daf-ada4-6bcf1898318c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.409509 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-302bb4c4-0d6f-4daf-ada4-6bcf1898318c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.411435 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-302bb4c4-0d6f-4daf-ada4-6bcf1898318c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.417100 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] HTTP exception thrown: Cannot 'attach_volume' instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 while it is in vm_state rescued Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Request method failure captured: Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: POST /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7/os-volume_attachments HTTP/1.1 Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 74 Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPflp1o9WogLAsdDvmSYbq3haIRqeuf6GL6xU3vqmbsanSflHqREzYieLzIoopLz13Y8ZWtiAhuSzGa5XP_uWH_z5C9p8hYLodvCvW6njxHN9XLwyQv63XoytrSUUxgC1j1Sx9JqPFo9z2KdVjTsbxxebQxUx3vj0rtsuddM65GxVY Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: d175790280c1443192810e2b789b9926 Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:17:10.422390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d175790280c1443192810e2b789b9926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d175790280c1443192810e2b789b9926"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: d175790280c1443192810e2b789b9926 Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 9e08af1e7f794f85b57d6912db529577 Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {"volumeAttachment": {"volumeId": "11012cc8-6d51-4a95-ab2d-c94f9e42dc7c"}} Jul 12 13:17:10.424097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Cannot 'attach_volume' instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 while it is in vm_state rescued Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'server_id': '185dde2b-5476-49f7-bf9d-65a6170bbbc7', 'body': {'volumeAttachment': {'volumeId': '11012cc8-6d51-4a95-ab2d-c94f9e42dc7c'}}} Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:17:10.425116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 while it is in vm_state rescued Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:17:10.426699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:17:10.428235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:17:10.428235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:17:10.428235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 while it is in vm_state rescued Jul 12 13:17:10.428235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:17:10.428235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Returning 409 to user: Cannot 'attach_volume' instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 while it is in vm_state rescued {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:17:10.428235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-62a18639-10ce-476a-af4b-6205d96aaeec tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052736 Jul 12 13:17:10.428235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 158/326] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:17:10 2022] POST /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 13:17:10.435434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-991cd19e-8374-4e5e-a202-891f44eaa986 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:10.436305 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-991cd19e-8374-4e5e-a202-891f44eaa986 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:10.443717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-991cd19e-8374-4e5e-a202-891f44eaa986 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.444245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-991cd19e-8374-4e5e-a202-891f44eaa986 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.445398 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-991cd19e-8374-4e5e-a202-891f44eaa986 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.446032 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-991cd19e-8374-4e5e-a202-891f44eaa986 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.558105 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-991cd19e-8374-4e5e-a202-891f44eaa986 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7/action" status: 202 len: 0 microversion: 2.1 time: 0.127275 Jul 12 13:17:10.559185 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 159/327] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:17:10 2022] POST /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 13:17:10.569370 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1fc5944f-b13c-4341-a6cb-da83b949c8ba tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:10.569973 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1fc5944f-b13c-4341-a6cb-da83b949c8ba tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:10.576501 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fc5944f-b13c-4341-a6cb-da83b949c8ba tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.577035 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fc5944f-b13c-4341-a6cb-da83b949c8ba tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.578058 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fc5944f-b13c-4341-a6cb-da83b949c8ba tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:10.578058 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1fc5944f-b13c-4341-a6cb-da83b949c8ba tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:10.701805 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-302bb4c4-0d6f-4daf-ada4-6bcf1898318c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:10.720349 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-302bb4c4-0d6f-4daf-ada4-6bcf1898318c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.335224 Jul 12 13:17:10.730366 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 169/328] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:10 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:10.772263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1fc5944f-b13c-4341-a6cb-da83b949c8ba tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:10.787531 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1fc5944f-b13c-4341-a6cb-da83b949c8ba tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1508 microversion: 2.1 time: 0.221766 Jul 12 13:17:10.788158 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 160/329] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:10 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:10.911522 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-606397659", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5765647a-f52d-4fde-ab6b-47dcfe530ab0"}], "security_groups": [{"name": "tempest-securitygroup--800551195"}], "key_name": "tempest-keypair-1276987071", "user_data": "}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:11.022425 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-966f94f9-4942-4c12-b247-c31c028422d7 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:11.024717 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] validate_networks() for [('5765647a-f52d-4fde-ab6b-47dcfe530ab0', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:17:11.030721 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-966f94f9-4942-4c12-b247-c31c028422d7 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:11.038763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-966f94f9-4942-4c12-b247-c31c028422d7 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.039548 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-966f94f9-4942-4c12-b247-c31c028422d7 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.040325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-966f94f9-4942-4c12-b247-c31c028422d7 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.040968 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-966f94f9-4942-4c12-b247-c31c028422d7 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.232775 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-966f94f9-4942-4c12-b247-c31c028422d7 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:11.243257 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-966f94f9-4942-4c12-b247-c31c028422d7 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1508 microversion: 2.1 time: 0.224580 Jul 12 13:17:11.244701 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 161/330] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:11 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:11.264730 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:11.266007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:11.279955 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.280738 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.282663 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.283289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.466419 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:11.475722 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:11.477221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:11.478901 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3064d616-a0c0-4f55-a8ec-e28b460a4a78 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.230163 Jul 12 13:17:11.479424 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 162/331] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:11 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:11.517589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:17:11.518184 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:17:11.518656 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:17:11.519088 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:17:11.520308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:17:11.530881 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.531582 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.533096 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.533721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.558531 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:17:11.564923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for user c8380cfce8114b609c8f0cbf9d445049 and project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:17:11.579488 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:17:11.582482 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:17:11.660951 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-feb8289a-9c08-493d-8922-62341aced635 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.755358 Jul 12 13:17:11.663716 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 170/332] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:17:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:17:11.675172 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-91805998-732b-4257-801a-cafaae660ba2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:11.676438 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-91805998-732b-4257-801a-cafaae660ba2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:11.741305 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4fb6f18a-8c70-4d21-a94f-6e0bd8b925ed tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:11.741972 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4fb6f18a-8c70-4d21-a94f-6e0bd8b925ed tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:11.762024 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4fb6f18a-8c70-4d21-a94f-6e0bd8b925ed tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.762446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4fb6f18a-8c70-4d21-a94f-6e0bd8b925ed tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.771993 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-91805998-732b-4257-801a-cafaae660ba2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:11.772288 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4fb6f18a-8c70-4d21-a94f-6e0bd8b925ed tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.773113 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4fb6f18a-8c70-4d21-a94f-6e0bd8b925ed tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.780199 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-91805998-732b-4257-801a-cafaae660ba2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1241 microversion: 2.1 time: 0.109976 Jul 12 13:17:11.789153 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 163/333] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:11 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:11.805982 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-543f6b04-e5f7-47d0-be30-6e0f2d3cc560 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:11.806631 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-543f6b04-e5f7-47d0-be30-6e0f2d3cc560 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:11.823569 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-543f6b04-e5f7-47d0-be30-6e0f2d3cc560 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.824003 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-543f6b04-e5f7-47d0-be30-6e0f2d3cc560 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.824941 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-543f6b04-e5f7-47d0-be30-6e0f2d3cc560 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:11.825365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-543f6b04-e5f7-47d0-be30-6e0f2d3cc560 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:11.834382 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=100 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:12.027964 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4fb6f18a-8c70-4d21-a94f-6e0bd8b925ed tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:12.037794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4fb6f18a-8c70-4d21-a94f-6e0bd8b925ed tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1255 microversion: 2.1 time: 0.302793 Jul 12 13:17:12.044033 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 171/334] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:11 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1255 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:12.173810 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-543f6b04-e5f7-47d0-be30-6e0f2d3cc560 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:12.182570 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-543f6b04-e5f7-47d0-be30-6e0f2d3cc560 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1508 microversion: 2.1 time: 0.380669 Jul 12 13:17:12.184277 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 164/335] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:11 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:12.497712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:12.498759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:12.506107 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:12.506635 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:12.507588 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:12.508040 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:12.659777 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:12.668856 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:12.670505 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:12.672129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-aeac1acc-cd2d-49c7-822e-5ac25a36e11a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.178854 Jul 12 13:17:12.673021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 172/336] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:12 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:12.800722 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-50f5aa55-8abc-41c3-add7-5688bf0d7cd7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:12.801258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-50f5aa55-8abc-41c3-add7-5688bf0d7cd7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:12.813061 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50f5aa55-8abc-41c3-add7-5688bf0d7cd7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:12.813918 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50f5aa55-8abc-41c3-add7-5688bf0d7cd7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:12.815002 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50f5aa55-8abc-41c3-add7-5688bf0d7cd7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:12.816448 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50f5aa55-8abc-41c3-add7-5688bf0d7cd7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:12.968355 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-50f5aa55-8abc-41c3-add7-5688bf0d7cd7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:13.012750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-50f5aa55-8abc-41c3-add7-5688bf0d7cd7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1245 microversion: 2.1 time: 0.218257 Jul 12 13:17:13.013814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 165/337] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:12 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1245 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:13.065240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7747196b-5190-4d59-b796-54fdb3648bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:13.069399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7747196b-5190-4d59-b796-54fdb3648bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:13.080370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7747196b-5190-4d59-b796-54fdb3648bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:13.081669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7747196b-5190-4d59-b796-54fdb3648bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:13.082947 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7747196b-5190-4d59-b796-54fdb3648bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:13.083800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7747196b-5190-4d59-b796-54fdb3648bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:13.202083 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dca60cc8-7870-4bb7-a6a7-ad8176a0b41b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:13.204021 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dca60cc8-7870-4bb7-a6a7-ad8176a0b41b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:13.219644 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dca60cc8-7870-4bb7-a6a7-ad8176a0b41b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:13.220416 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dca60cc8-7870-4bb7-a6a7-ad8176a0b41b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:13.221521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dca60cc8-7870-4bb7-a6a7-ad8176a0b41b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:13.221963 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dca60cc8-7870-4bb7-a6a7-ad8176a0b41b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:13.313039 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7747196b-5190-4d59-b796-54fdb3648bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:13.327266 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7747196b-5190-4d59-b796-54fdb3648bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1439 microversion: 2.1 time: 0.268937 Jul 12 13:17:13.328834 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 173/338] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:13 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1439 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:13.346391 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fbcaa857-dd52-4fd5-9f5c-25b5a6a6dcb0 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:13.347869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fbcaa857-dd52-4fd5-9f5c-25b5a6a6dcb0 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:13.358428 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fbcaa857-dd52-4fd5-9f5c-25b5a6a6dcb0 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:13.359393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fbcaa857-dd52-4fd5-9f5c-25b5a6a6dcb0 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:13.360380 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fbcaa857-dd52-4fd5-9f5c-25b5a6a6dcb0 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:13.361136 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fbcaa857-dd52-4fd5-9f5c-25b5a6a6dcb0 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:13.450863 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dca60cc8-7870-4bb7-a6a7-ad8176a0b41b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:13.465457 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dca60cc8-7870-4bb7-a6a7-ad8176a0b41b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1508 microversion: 2.1 time: 0.268823 Jul 12 13:17:13.466636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 166/339] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:13 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:13.538610 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fbcaa857-dd52-4fd5-9f5c-25b5a6a6dcb0 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:13.548324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fbcaa857-dd52-4fd5-9f5c-25b5a6a6dcb0 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1439 microversion: 2.1 time: 0.206480 Jul 12 13:17:13.549579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 174/340] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:13 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1439 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:13.692793 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:13.693891 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:13.708644 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:13.714205 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:13.721388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:13.722250 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:14.009281 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:14.018032 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:14.019582 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:14.020736 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-454b2cc2-25fd-4040-927a-28a69aff89d4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.334652 Jul 12 13:17:14.021530 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 167/341] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:13 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:14.036109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a9024ac1-0a3d-4aed-96d6-3f1d282dc588 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:14.036868 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a9024ac1-0a3d-4aed-96d6-3f1d282dc588 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:14.047334 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a9024ac1-0a3d-4aed-96d6-3f1d282dc588 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:14.047840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a9024ac1-0a3d-4aed-96d6-3f1d282dc588 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:14.048748 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a9024ac1-0a3d-4aed-96d6-3f1d282dc588 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:14.049243 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a9024ac1-0a3d-4aed-96d6-3f1d282dc588 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:14.144974 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a9024ac1-0a3d-4aed-96d6-3f1d282dc588 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:14.154867 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a9024ac1-0a3d-4aed-96d6-3f1d282dc588 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1299 microversion: 2.1 time: 0.128579 Jul 12 13:17:14.155446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 175/342] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:14 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:14.486330 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-229dcca0-37db-44d7-b17c-9a51849b426b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:14.486944 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-229dcca0-37db-44d7-b17c-9a51849b426b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:14.495776 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-229dcca0-37db-44d7-b17c-9a51849b426b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:14.496487 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-229dcca0-37db-44d7-b17c-9a51849b426b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:14.497520 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-229dcca0-37db-44d7-b17c-9a51849b426b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:14.497899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-229dcca0-37db-44d7-b17c-9a51849b426b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:14.652988 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-229dcca0-37db-44d7-b17c-9a51849b426b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:14.661179 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-229dcca0-37db-44d7-b17c-9a51849b426b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1508 microversion: 2.1 time: 0.178905 Jul 12 13:17:14.662263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 168/343] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:14 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:15.039743 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:15.040546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:15.048395 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:15.048953 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:15.050367 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:15.050894 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:15.173723 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f9145bf3-9c5e-4764-9868-02d84d6fdd41 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:15.175260 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f9145bf3-9c5e-4764-9868-02d84d6fdd41 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:15.182031 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9145bf3-9c5e-4764-9868-02d84d6fdd41 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:15.182711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9145bf3-9c5e-4764-9868-02d84d6fdd41 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:15.183681 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9145bf3-9c5e-4764-9868-02d84d6fdd41 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:15.184114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9145bf3-9c5e-4764-9868-02d84d6fdd41 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:15.255447 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f9145bf3-9c5e-4764-9868-02d84d6fdd41 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:15.263008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f9145bf3-9c5e-4764-9868-02d84d6fdd41 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1299 microversion: 2.1 time: 0.093635 Jul 12 13:17:15.263896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 169/344] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:15 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:15.320353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:15.330049 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:15.331651 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:15.333200 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-30871a32-2b82-44c5-aba5-ccebb1334ba9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.297560 Jul 12 13:17:15.334135 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 176/345] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:15 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:15.690166 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-51fe27a4-f4a8-4c13-bd4c-8b863612d60f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:15.691165 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-51fe27a4-f4a8-4c13-bd4c-8b863612d60f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:15.706856 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51fe27a4-f4a8-4c13-bd4c-8b863612d60f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:15.707512 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51fe27a4-f4a8-4c13-bd4c-8b863612d60f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:15.708370 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51fe27a4-f4a8-4c13-bd4c-8b863612d60f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:15.708859 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51fe27a4-f4a8-4c13-bd4c-8b863612d60f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:15.967712 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-51fe27a4-f4a8-4c13-bd4c-8b863612d60f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:15.985622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-51fe27a4-f4a8-4c13-bd4c-8b863612d60f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1508 microversion: 2.1 time: 0.307422 Jul 12 13:17:15.986624 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 170/346] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:15 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:16.263834 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-2513397f-f164-413b-815e-d81f3979288b req-ba26ef6a-2698-46e3-8f82-99f9e153930b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1b8589-d954-4806-9228-47ea80451712", "tag": "22d70302-4120-482b-8c1c-525d7d7ba7f4"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:16.269424 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:16.277578 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-2513397f-f164-413b-815e-d81f3979288b req-ba26ef6a-2698-46e3-8f82-99f9e153930b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:16.278312 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-2513397f-f164-413b-815e-d81f3979288b req-ba26ef6a-2698-46e3-8f82-99f9e153930b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:16.281115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bff08da9-5444-4567-b4be-ae4afd849c4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:16.281819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bff08da9-5444-4567-b4be-ae4afd849c4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:16.292575 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-2513397f-f164-413b-815e-d81f3979288b req-ba26ef6a-2698-46e3-8f82-99f9e153930b service nova] Creating event network-changed:22d70302-4120-482b-8c1c-525d7d7ba7f4 for instance 5c1b8589-d954-4806-9228-47ea80451712 on hv-cinder-79760 Jul 12 13:17:16.295391 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bff08da9-5444-4567-b4be-ae4afd849c4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:16.295929 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bff08da9-5444-4567-b4be-ae4afd849c4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:16.298587 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-2513397f-f164-413b-815e-d81f3979288b req-ba26ef6a-2698-46e3-8f82-99f9e153930b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041918 Jul 12 13:17:16.299747 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 177/347] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:17:16.302608 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bff08da9-5444-4567-b4be-ae4afd849c4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:16.303415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bff08da9-5444-4567-b4be-ae4afd849c4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:16.360507 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:16.361234 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:16.373890 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:16.374654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:16.375783 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:16.376552 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:16.583266 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:16.596379 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:16.598329 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:16.599705 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b32d1583-eea9-4223-a552-2bdf75c9ee7d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.250893 Jul 12 13:17:16.614756 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 178/348] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:16 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:16.759629 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bff08da9-5444-4567-b4be-ae4afd849c4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:16.769458 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bff08da9-5444-4567-b4be-ae4afd849c4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1299 microversion: 2.1 time: 0.494061 Jul 12 13:17:16.770455 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 171/349] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:16 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1299 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:17.005207 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ae8f9e43-002a-4289-900c-ea5ece963496 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:17.022695 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ae8f9e43-002a-4289-900c-ea5ece963496 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:17.051174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ae8f9e43-002a-4289-900c-ea5ece963496 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:17.052131 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ae8f9e43-002a-4289-900c-ea5ece963496 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:17.053215 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ae8f9e43-002a-4289-900c-ea5ece963496 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:17.054022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ae8f9e43-002a-4289-900c-ea5ece963496 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:17.374876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ae8f9e43-002a-4289-900c-ea5ece963496 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:17.384120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ae8f9e43-002a-4289-900c-ea5ece963496 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1514 microversion: 2.1 time: 0.385006 Jul 12 13:17:17.402344 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 179/350] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:16 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:17.622411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:17.625862 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:17.636198 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:17.637053 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:17.638199 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:17.638936 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:17.685980 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:17.809576 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-374af1cc-e835-4051-9cf5-a9aac6145bdd tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:17.812060 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-374af1cc-e835-4051-9cf5-a9aac6145bdd tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:17.845137 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-374af1cc-e835-4051-9cf5-a9aac6145bdd tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:17.848308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-374af1cc-e835-4051-9cf5-a9aac6145bdd tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:17.858364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-374af1cc-e835-4051-9cf5-a9aac6145bdd tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:17.859576 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-374af1cc-e835-4051-9cf5-a9aac6145bdd tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:18.073535 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:18.084052 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:18.092912 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:18.094611 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-50f7d77b-d6de-46c2-afb5-8b356dc14dd5 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.477226 Jul 12 13:17:18.097475 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 172/351] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:17 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:18.161979 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-374af1cc-e835-4051-9cf5-a9aac6145bdd tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:18.170618 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-374af1cc-e835-4051-9cf5-a9aac6145bdd tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.382540 Jul 12 13:17:18.171565 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 180/352] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:17 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:18.574488 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-005578d5-03bf-4b5f-a7be-53f416178767 req-b28caa7f-b29f-45ab-bcdb-952e32fb13c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d99dc0b-1835-4e7b-816b-2315dbe1a12a", "tag": "b093819a-294c-4c02-8673-aaec05b9bd6a"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:18.587346 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-005578d5-03bf-4b5f-a7be-53f416178767 req-b28caa7f-b29f-45ab-bcdb-952e32fb13c9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:18.588283 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-005578d5-03bf-4b5f-a7be-53f416178767 req-b28caa7f-b29f-45ab-bcdb-952e32fb13c9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:18.605058 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-005578d5-03bf-4b5f-a7be-53f416178767 req-b28caa7f-b29f-45ab-bcdb-952e32fb13c9 service nova] Creating event network-changed:b093819a-294c-4c02-8673-aaec05b9bd6a for instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a on hv-cinder-79760 Jul 12 13:17:18.611690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-005578d5-03bf-4b5f-a7be-53f416178767 req-b28caa7f-b29f-45ab-bcdb-952e32fb13c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040603 Jul 12 13:17:18.612516 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 173/353] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:19.044055 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-087995ce-2751-4bc5-b381-8852796cca91 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'create', calling method: .version_select at 0x7fd48d1813a0>, body: {"keypair": {"name": "tempest-keypair-2037036041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsi0Wt+R5Q8kPnSrWy7EwIeej+nRKoxnQn5joOONA26MkwOY8lRq3hOzdBlWVJOGRT3+yz6v+lyxqvJx+uNm8X/lpM1gaffG9cA7aU90CorlMZFnf4gcoSOByd/Nvv5Wg=="}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:19.064365 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-087995ce-2751-4bc5-b381-8852796cca91 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Getting quotas for project d175790280c1443192810e2b789b9926. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:17:19.070252 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-087995ce-2751-4bc5-b381-8852796cca91 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Getting quotas for user 9e08af1e7f794f85b57d6912db529577 and project d175790280c1443192810e2b789b9926. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:17:19.122170 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:19.127881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:19.168011 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-087995ce-2751-4bc5-b381-8852796cca91 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128899 Jul 12 13:17:19.172215 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 181/354] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:17:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:19.175652 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:19.176095 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:19.177083 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:19.177529 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:19.188063 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5761f54a-b019-4965-a3fe-3eb4d29a30af tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:19.189122 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-5761f54a-b019-4965-a3fe-3eb4d29a30af tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:19.196589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5761f54a-b019-4965-a3fe-3eb4d29a30af tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:19.197558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5761f54a-b019-4965-a3fe-3eb4d29a30af tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:19.200006 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5761f54a-b019-4965-a3fe-3eb4d29a30af tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:19.200747 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5761f54a-b019-4965-a3fe-3eb4d29a30af tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:19.408534 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5761f54a-b019-4965-a3fe-3eb4d29a30af tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:19.418717 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5761f54a-b019-4965-a3fe-3eb4d29a30af tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.235414 Jul 12 13:17:19.433383 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 182/355] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:19 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:19.456814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:19.486111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:19.488711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:19.492555 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-67cd50fa-7b48-458e-9b82-a8bb651ad2df tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.378564 Jul 12 13:17:19.496039 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 174/356] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:19 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:20.441828 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0c96ead3-dffa-4c9b-b6d2-50d132860824 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:20.442446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0c96ead3-dffa-4c9b-b6d2-50d132860824 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:20.449220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0c96ead3-dffa-4c9b-b6d2-50d132860824 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:20.454680 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0c96ead3-dffa-4c9b-b6d2-50d132860824 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:20.455810 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0c96ead3-dffa-4c9b-b6d2-50d132860824 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:20.456257 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0c96ead3-dffa-4c9b-b6d2-50d132860824 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:20.512494 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:20.513093 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:20.520530 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:20.521402 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:20.522524 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:20.523133 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:20.633535 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0c96ead3-dffa-4c9b-b6d2-50d132860824 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:20.647228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0c96ead3-dffa-4c9b-b6d2-50d132860824 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.209384 Jul 12 13:17:20.649293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 183/357] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:20 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:20.822744 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:20.832684 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:20.834788 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:20.836183 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-17ffc255-911a-4f24-8ceb-7917865cec16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.328751 Jul 12 13:17:20.841622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 175/358] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:20 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:21.072860 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-648572778", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca5e922c-b92d-4e11-a28c-945e9c62e240"}], "security_groups": [{"name": "tempest-securitygroup--1275428785"}], "key_name": "tempest-keypair-2037036041", "user_data": "}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:21.548459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:21.664966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1be92c0e-94dd-41a9-a9fc-2dcc6533f780 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:21.665526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1be92c0e-94dd-41a9-a9fc-2dcc6533f780 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:21.682509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1be92c0e-94dd-41a9-a9fc-2dcc6533f780 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:21.683259 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1be92c0e-94dd-41a9-a9fc-2dcc6533f780 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:21.684237 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1be92c0e-94dd-41a9-a9fc-2dcc6533f780 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:21.684851 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1be92c0e-94dd-41a9-a9fc-2dcc6533f780 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:21.779154 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=6 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:21.855245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1be92c0e-94dd-41a9-a9fc-2dcc6533f780 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:21.865189 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1be92c0e-94dd-41a9-a9fc-2dcc6533f780 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.204100 Jul 12 13:17:21.865997 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 176/359] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:21 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:21.872502 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:21.875038 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:21.885893 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:21.887289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:21.889055 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:21.889869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:22.053837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:22.062588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:22.064142 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:22.065335 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3f5926b7-ff93-4b41-9fd1-5756289d652e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.198054 Jul 12 13:17:22.066989 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 177/360] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:21 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:22.884325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2f9b2218-1d93-4df5-98aa-0c977e3deb18 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:22.885020 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2f9b2218-1d93-4df5-98aa-0c977e3deb18 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:22.892750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f9b2218-1d93-4df5-98aa-0c977e3deb18 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:22.893205 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f9b2218-1d93-4df5-98aa-0c977e3deb18 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:22.893994 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f9b2218-1d93-4df5-98aa-0c977e3deb18 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:22.894434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2f9b2218-1d93-4df5-98aa-0c977e3deb18 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:23.034458 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2f9b2218-1d93-4df5-98aa-0c977e3deb18 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:23.042748 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2f9b2218-1d93-4df5-98aa-0c977e3deb18 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.161966 Jul 12 13:17:23.043690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 178/361] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:22 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:23.086397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:23.087183 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:23.093780 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:23.094332 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:23.095127 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:23.095563 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:23.249430 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:23.258781 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:23.260399 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:23.261559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-95efb435-30c2-4198-92db-e48617aad98d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1743 microversion: 2.20 time: 0.179595 Jul 12 13:17:23.262153 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 179/362] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:23 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:24.059558 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-48ceec8b-69a4-480c-95bc-4f3a6dc514e9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:24.060282 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-48ceec8b-69a4-480c-95bc-4f3a6dc514e9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:24.067529 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48ceec8b-69a4-480c-95bc-4f3a6dc514e9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:24.068395 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48ceec8b-69a4-480c-95bc-4f3a6dc514e9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:24.069433 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48ceec8b-69a4-480c-95bc-4f3a6dc514e9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:24.070110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-48ceec8b-69a4-480c-95bc-4f3a6dc514e9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:24.223628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-48ceec8b-69a4-480c-95bc-4f3a6dc514e9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:24.232965 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-48ceec8b-69a4-480c-95bc-4f3a6dc514e9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.177313 Jul 12 13:17:24.234349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 180/363] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:24 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:24.281006 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:24.281791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:24.284832 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:24.289668 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:24.290125 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:24.290901 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:24.291373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:24.430091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:24.441818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:24.443779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:24.445356 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a0f39831-82ba-4bfa-b8c5-e76f3e5cc4ee tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1743 microversion: 2.20 time: 0.168963 Jul 12 13:17:24.445946 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 181/364] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:24 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:25.250665 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f9a80403-7b36-4531-b9bb-770a6b345889 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:25.251384 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f9a80403-7b36-4531-b9bb-770a6b345889 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:25.258252 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9a80403-7b36-4531-b9bb-770a6b345889 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:25.258975 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9a80403-7b36-4531-b9bb-770a6b345889 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:25.259919 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9a80403-7b36-4531-b9bb-770a6b345889 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:25.260534 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f9a80403-7b36-4531-b9bb-770a6b345889 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:25.419962 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f9a80403-7b36-4531-b9bb-770a6b345889 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:25.428626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f9a80403-7b36-4531-b9bb-770a6b345889 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.182603 Jul 12 13:17:25.429202 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 182/365] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:25 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:25.465702 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:25.466507 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:25.473174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:25.473824 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:25.474669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:25.475208 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:25.626265 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:25.640764 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:25.642376 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:25.648425 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b8144700-f732-4243-8e30-1f456ea1c712 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.186513 Jul 12 13:17:25.649758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 183/366] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:25 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:25.850220 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-6515d1e4-14f6-410e-94bb-6142180255ea req-c4cf5de9-6413-424e-b0a6-93e97fc20db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a8f841-941e-4a72-a5c0-66cf4c1f7ebc", "name": "network-vif-plugged", "status": "completed", "tag": "aecd26f4-285f-454f-8ddb-ecfc55407ec5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:25.861086 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-6515d1e4-14f6-410e-94bb-6142180255ea req-c4cf5de9-6413-424e-b0a6-93e97fc20db0 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:25.862741 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-6515d1e4-14f6-410e-94bb-6142180255ea req-c4cf5de9-6413-424e-b0a6-93e97fc20db0 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:25.877902 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-6515d1e4-14f6-410e-94bb-6142180255ea req-c4cf5de9-6413-424e-b0a6-93e97fc20db0 service nova] Creating event network-vif-plugged:aecd26f4-285f-454f-8ddb-ecfc55407ec5 for instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc on hv-cinder-79760 Jul 12 13:17:25.884170 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-6515d1e4-14f6-410e-94bb-6142180255ea req-c4cf5de9-6413-424e-b0a6-93e97fc20db0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038615 Jul 12 13:17:25.885611 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 184/367] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:26.447481 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-562ae257-c245-45a9-ac3a-ce72e51e1688 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:26.449195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-562ae257-c245-45a9-ac3a-ce72e51e1688 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:26.459159 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-562ae257-c245-45a9-ac3a-ce72e51e1688 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:26.459712 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-562ae257-c245-45a9-ac3a-ce72e51e1688 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:26.460900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-562ae257-c245-45a9-ac3a-ce72e51e1688 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:26.461626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-562ae257-c245-45a9-ac3a-ce72e51e1688 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:26.608448 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-562ae257-c245-45a9-ac3a-ce72e51e1688 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:26.616741 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-562ae257-c245-45a9-ac3a-ce72e51e1688 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.174410 Jul 12 13:17:26.617335 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 185/368] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:26 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:26.670068 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:26.670791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:26.679290 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:26.680092 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:26.680897 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:26.681412 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:26.833990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:26.845263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:26.847728 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:26.849456 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0ce507e4-45ea-41ba-9b78-f9cfb0ddda80 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.185104 Jul 12 13:17:26.863107 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 186/369] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:26 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:27.638722 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-005f3d00-f246-48e7-8bc1-bf81e0651178 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:27.640492 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-005f3d00-f246-48e7-8bc1-bf81e0651178 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:27.648857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-005f3d00-f246-48e7-8bc1-bf81e0651178 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:27.649392 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-005f3d00-f246-48e7-8bc1-bf81e0651178 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:27.650336 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-005f3d00-f246-48e7-8bc1-bf81e0651178 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:27.650771 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-005f3d00-f246-48e7-8bc1-bf81e0651178 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:27.806275 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-005f3d00-f246-48e7-8bc1-bf81e0651178 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:27.814539 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-005f3d00-f246-48e7-8bc1-bf81e0651178 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.183986 Jul 12 13:17:27.815438 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 187/370] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:27 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:27.872460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:27.873306 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:27.882736 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:27.883212 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:27.884075 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:27.884703 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:28.038033 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:28.048428 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:28.050283 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:28.051509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6b723e9c-05e3-4657-a7bf-78ed77665fc4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.184663 Jul 12 13:17:28.052072 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 188/371] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:27 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:28.831338 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-daa1eeb8-1a2b-4e20-8566-31a35bd58a2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:28.832069 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-daa1eeb8-1a2b-4e20-8566-31a35bd58a2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:28.845258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-daa1eeb8-1a2b-4e20-8566-31a35bd58a2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:28.845705 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-daa1eeb8-1a2b-4e20-8566-31a35bd58a2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:28.846481 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-daa1eeb8-1a2b-4e20-8566-31a35bd58a2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:28.846906 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-daa1eeb8-1a2b-4e20-8566-31a35bd58a2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:28.991810 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-daa1eeb8-1a2b-4e20-8566-31a35bd58a2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:28.999878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-daa1eeb8-1a2b-4e20-8566-31a35bd58a2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.172467 Jul 12 13:17:29.000442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 189/372] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:28 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:29.074459 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:29.075363 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:29.083045 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=10 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:29.083922 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:29.084872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:29.085735 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:29.086528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:29.107048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:29.237836 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:29.246637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:29.248271 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:29.249477 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-45358ab4-fc4c-47f7-9de6-6bdcf4c45800 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.180352 Jul 12 13:17:29.250753 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 190/373] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:29 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:29.830238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] validate_networks() for [('ca5e922c-b92d-4e11-a28c-945e9c62e240', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:17:30.018307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9b9561d2-31bd-4af6-b08f-90f5e267436d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:30.018997 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9b9561d2-31bd-4af6-b08f-90f5e267436d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:30.028568 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9b9561d2-31bd-4af6-b08f-90f5e267436d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:30.028568 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9b9561d2-31bd-4af6-b08f-90f5e267436d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:30.028568 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9b9561d2-31bd-4af6-b08f-90f5e267436d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:30.028568 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9b9561d2-31bd-4af6-b08f-90f5e267436d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:30.174036 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9b9561d2-31bd-4af6-b08f-90f5e267436d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:30.181821 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9b9561d2-31bd-4af6-b08f-90f5e267436d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.168378 Jul 12 13:17:30.182503 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 191/374] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:30 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:30.226295 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:17:30.226742 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:17:30.227216 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:17:30.227603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:17:30.228007 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:17:30.237714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:30.238147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:30.238925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:30.239387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:30.256347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Getting quotas for project d175790280c1443192810e2b789b9926. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:17:30.260222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Getting quotas for user 9e08af1e7f794f85b57d6912db529577 and project d175790280c1443192810e2b789b9926. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:17:30.268551 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:30.269238 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:30.271111 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:17:30.273850 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:17:30.278002 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:30.278450 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:30.279239 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:30.279669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:30.323572 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-acf0d5e7-b71c-43ac-915e-26371c86f081 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 9.255796 Jul 12 13:17:30.324285 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 184/375] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:17:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 9257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:17:30.334789 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ad9f4017-1a82-4efc-bee1-6f86d62ecd51 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:30.335729 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ad9f4017-1a82-4efc-bee1-6f86d62ecd51 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:30.390327 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ad9f4017-1a82-4efc-bee1-6f86d62ecd51 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:30.398540 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ad9f4017-1a82-4efc-bee1-6f86d62ecd51 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1245 microversion: 2.1 time: 0.067837 Jul 12 13:17:30.399151 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 185/376] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:30 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:30.428757 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:30.437662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:30.439750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:30.440973 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c5b87c47-c3cc-4129-8abf-10d1a8eb40d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.176670 Jul 12 13:17:30.441594 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 192/377] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:30 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:31.201442 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-70d5e9f9-9cca-49b9-9124-df2e319e54f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:31.202116 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-70d5e9f9-9cca-49b9-9124-df2e319e54f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:31.210026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-70d5e9f9-9cca-49b9-9124-df2e319e54f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:31.210457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-70d5e9f9-9cca-49b9-9124-df2e319e54f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:31.211450 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-70d5e9f9-9cca-49b9-9124-df2e319e54f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:31.211888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-70d5e9f9-9cca-49b9-9124-df2e319e54f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:31.385069 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-70d5e9f9-9cca-49b9-9124-df2e319e54f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:31.397960 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-70d5e9f9-9cca-49b9-9124-df2e319e54f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.199858 Jul 12 13:17:31.399131 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 186/378] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:31 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:31.415494 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f18d3306-9b90-4859-85b7-2e70646ad3e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:31.416096 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f18d3306-9b90-4859-85b7-2e70646ad3e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:31.423414 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f18d3306-9b90-4859-85b7-2e70646ad3e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:31.423886 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f18d3306-9b90-4859-85b7-2e70646ad3e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:31.424638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f18d3306-9b90-4859-85b7-2e70646ad3e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:31.425053 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f18d3306-9b90-4859-85b7-2e70646ad3e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:31.459363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:31.460005 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:31.467931 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:31.468546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:31.469459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:31.470058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:31.503499 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f18d3306-9b90-4859-85b7-2e70646ad3e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:31.512525 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f18d3306-9b90-4859-85b7-2e70646ad3e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1241 microversion: 2.1 time: 0.100796 Jul 12 13:17:31.513112 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 193/379] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:31 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:31.692101 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:31.702118 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:31.705631 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:31.707291 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-bd2a3f78-b5f2-4088-8f67-8f552ef4fd06 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.252884 Jul 12 13:17:31.720054 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 187/380] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:31 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:32.416762 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f034724f-4905-4a29-9481-701506827c55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:32.418389 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f034724f-4905-4a29-9481-701506827c55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:32.427039 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f034724f-4905-4a29-9481-701506827c55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:32.427763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f034724f-4905-4a29-9481-701506827c55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:32.428536 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f034724f-4905-4a29-9481-701506827c55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:32.429121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f034724f-4905-4a29-9481-701506827c55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:32.530588 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e3e4bcea-9dca-4f47-80a9-f6bf67587d96 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:32.531923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e3e4bcea-9dca-4f47-80a9-f6bf67587d96 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:32.539585 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e3e4bcea-9dca-4f47-80a9-f6bf67587d96 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:32.540325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e3e4bcea-9dca-4f47-80a9-f6bf67587d96 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:32.541106 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e3e4bcea-9dca-4f47-80a9-f6bf67587d96 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:32.541711 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e3e4bcea-9dca-4f47-80a9-f6bf67587d96 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:32.620911 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e3e4bcea-9dca-4f47-80a9-f6bf67587d96 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:32.629999 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e3e4bcea-9dca-4f47-80a9-f6bf67587d96 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1303 microversion: 2.1 time: 0.104101 Jul 12 13:17:32.630594 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 188/381] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:32 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:32.644140 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f034724f-4905-4a29-9481-701506827c55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:32.655619 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f034724f-4905-4a29-9481-701506827c55 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.242952 Jul 12 13:17:32.661076 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 194/382] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:32 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:32.729737 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:32.730353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:32.741942 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:32.743465 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:32.744723 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:32.745313 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:33.093079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:33.105447 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:33.107727 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:33.109542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b8b980c3-a236-48d6-b66a-9f23d13db910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.387283 Jul 12 13:17:33.121394 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 189/383] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:32 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:33.650478 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2d9b917a-5ea0-4fce-a6d7-32b206d03ea8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:33.651745 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2d9b917a-5ea0-4fce-a6d7-32b206d03ea8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:33.667982 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d9b917a-5ea0-4fce-a6d7-32b206d03ea8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:33.677960 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3083aa32-909e-4c55-b429-12844652f7da tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:33.678569 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3083aa32-909e-4c55-b429-12844652f7da tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:33.681189 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d9b917a-5ea0-4fce-a6d7-32b206d03ea8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:33.686199 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d9b917a-5ea0-4fce-a6d7-32b206d03ea8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:33.687613 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d9b917a-5ea0-4fce-a6d7-32b206d03ea8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:33.692455 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3083aa32-909e-4c55-b429-12844652f7da tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:33.693586 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3083aa32-909e-4c55-b429-12844652f7da tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:33.694399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3083aa32-909e-4c55-b429-12844652f7da tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:33.698702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3083aa32-909e-4c55-b429-12844652f7da tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:34.146268 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3083aa32-909e-4c55-b429-12844652f7da tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:34.155625 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3083aa32-909e-4c55-b429-12844652f7da tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.480882 Jul 12 13:17:34.158491 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 190/384] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:33 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:34.168356 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2d9b917a-5ea0-4fce-a6d7-32b206d03ea8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:34.198241 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2d9b917a-5ea0-4fce-a6d7-32b206d03ea8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.547872 Jul 12 13:17:34.198714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-96804049-5661-4c35-9db5-d92a09245ebd req-54d1fe16-868e-492c-8bc7-cca76a6de7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d99dc0b-1835-4e7b-816b-2315dbe1a12a", "name": "network-vif-plugged", "status": "completed", "tag": "b093819a-294c-4c02-8673-aaec05b9bd6a"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:34.200887 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 195/385] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:33 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:34.214124 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:34.225592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:34.230975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-96804049-5661-4c35-9db5-d92a09245ebd req-54d1fe16-868e-492c-8bc7-cca76a6de7eb service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:34.236626 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-96804049-5661-4c35-9db5-d92a09245ebd req-54d1fe16-868e-492c-8bc7-cca76a6de7eb service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:34.246526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:34.252660 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:34.254302 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:34.258599 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:34.270111 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-96804049-5661-4c35-9db5-d92a09245ebd req-54d1fe16-868e-492c-8bc7-cca76a6de7eb service nova] Creating event network-vif-plugged:b093819a-294c-4c02-8673-aaec05b9bd6a for instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a on hv-cinder-79760 Jul 12 13:17:34.281699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-96804049-5661-4c35-9db5-d92a09245ebd req-54d1fe16-868e-492c-8bc7-cca76a6de7eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120285 Jul 12 13:17:34.282810 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 191/386] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:34.608969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:34.619753 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:34.621246 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:34.622413 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fe8e3f09-c352-4f56-9e72-c10a8ab74def tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.418125 Jul 12 13:17:34.622974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 196/387] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:34 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:34.992702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-fbb6cb8a-750f-4529-b17e-366b31d4c8d5 req-70dcd55f-b8e1-4260-a8e2-1514f077037b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7df43b-4b7b-46af-ad37-d0267407bff2", "tag": "2a046eef-1dcf-44d2-be29-2ae216e4b855"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:35.006109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-fbb6cb8a-750f-4529-b17e-366b31d4c8d5 req-70dcd55f-b8e1-4260-a8e2-1514f077037b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:35.006753 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-fbb6cb8a-750f-4529-b17e-366b31d4c8d5 req-70dcd55f-b8e1-4260-a8e2-1514f077037b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:35.011981 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=100 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:35.029045 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-fbb6cb8a-750f-4529-b17e-366b31d4c8d5 req-70dcd55f-b8e1-4260-a8e2-1514f077037b service nova] Creating event network-changed:2a046eef-1dcf-44d2-be29-2ae216e4b855 for instance bd7df43b-4b7b-46af-ad37-d0267407bff2 on hv-cinder-79760 Jul 12 13:17:35.037810 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-fbb6cb8a-750f-4529-b17e-366b31d4c8d5 req-70dcd55f-b8e1-4260-a8e2-1514f077037b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049952 Jul 12 13:17:35.038418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 192/388] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:17:35.174419 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e90e0b91-c043-4318-8091-01be22a4528e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:35.175299 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e90e0b91-c043-4318-8091-01be22a4528e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:35.185667 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e90e0b91-c043-4318-8091-01be22a4528e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:35.186161 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e90e0b91-c043-4318-8091-01be22a4528e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:35.186973 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e90e0b91-c043-4318-8091-01be22a4528e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:35.187395 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e90e0b91-c043-4318-8091-01be22a4528e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:35.220623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-053839d6-b091-49ad-87b3-54433e175650 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:35.222443 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-053839d6-b091-49ad-87b3-54433e175650 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:35.230041 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-053839d6-b091-49ad-87b3-54433e175650 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:35.230480 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-053839d6-b091-49ad-87b3-54433e175650 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:35.231286 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-053839d6-b091-49ad-87b3-54433e175650 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:35.231853 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-053839d6-b091-49ad-87b3-54433e175650 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:35.442688 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e90e0b91-c043-4318-8091-01be22a4528e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:35.451291 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e90e0b91-c043-4318-8091-01be22a4528e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1366 microversion: 2.1 time: 0.280906 Jul 12 13:17:35.452148 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 197/389] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:35 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:35.474550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-053839d6-b091-49ad-87b3-54433e175650 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:35.484082 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-053839d6-b091-49ad-87b3-54433e175650 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.270086 Jul 12 13:17:35.493559 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 193/390] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:35 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:35.605512 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8576367e-ae4a-4efb-a160-03e87bc4b911 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b27a8db-c547-4ef3-98f6-038f136cd3dc", "device": "/dev/sdb"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:35.608167 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8576367e-ae4a-4efb-a160-03e87bc4b911 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:35.614808 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8576367e-ae4a-4efb-a160-03e87bc4b911 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:35.615484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8576367e-ae4a-4efb-a160-03e87bc4b911 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:35.616830 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8576367e-ae4a-4efb-a160-03e87bc4b911 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:35.617507 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8576367e-ae4a-4efb-a160-03e87bc4b911 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:35.641950 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:35.642598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:35.654533 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:35.655006 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:35.655794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:35.675641 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:35.855644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:35.868255 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:35.870831 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:35.873082 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-780d742a-23af-4bfc-b055-4cc4c7174f30 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.235560 Jul 12 13:17:35.874942 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 194/391] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:35 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:36.096129 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8576367e-ae4a-4efb-a160-03e87bc4b911 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "POST /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497089 Jul 12 13:17:36.104851 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 198/392] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:17:35 2022] POST /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:36.469884 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a2b051d5-75fb-4bf5-9ff5-507d93d966f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:36.470786 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a2b051d5-75fb-4bf5-9ff5-507d93d966f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:36.477777 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2b051d5-75fb-4bf5-9ff5-507d93d966f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:36.478457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2b051d5-75fb-4bf5-9ff5-507d93d966f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:36.479467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2b051d5-75fb-4bf5-9ff5-507d93d966f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:36.479956 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2b051d5-75fb-4bf5-9ff5-507d93d966f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:36.504174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cadc1341-1717-496d-bbb5-8e1be4626bcb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:36.505545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cadc1341-1717-496d-bbb5-8e1be4626bcb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:36.515902 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cadc1341-1717-496d-bbb5-8e1be4626bcb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:36.516636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cadc1341-1717-496d-bbb5-8e1be4626bcb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:36.517866 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cadc1341-1717-496d-bbb5-8e1be4626bcb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:36.518299 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cadc1341-1717-496d-bbb5-8e1be4626bcb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:36.631671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a2b051d5-75fb-4bf5-9ff5-507d93d966f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:36.639840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a2b051d5-75fb-4bf5-9ff5-507d93d966f1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1556 microversion: 2.1 time: 0.175759 Jul 12 13:17:36.652801 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 195/393] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:36 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:36.658329 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a231b5fb-eceb-4a58-82e1-981c730978b8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:36.659106 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a231b5fb-eceb-4a58-82e1-981c730978b8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:36.665906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a231b5fb-eceb-4a58-82e1-981c730978b8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:36.666603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a231b5fb-eceb-4a58-82e1-981c730978b8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:36.667884 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a231b5fb-eceb-4a58-82e1-981c730978b8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:36.668412 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cadc1341-1717-496d-bbb5-8e1be4626bcb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:36.668653 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a231b5fb-eceb-4a58-82e1-981c730978b8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:36.677364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cadc1341-1717-496d-bbb5-8e1be4626bcb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.179193 Jul 12 13:17:36.678398 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 199/394] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:36 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:36.758718 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a231b5fb-eceb-4a58-82e1-981c730978b8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104439 Jul 12 13:17:36.765698 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 196/395] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 12 13:17:36 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:36.892420 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:36.893541 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:36.900900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:36.902134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:36.903134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:36.904211 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:37.144361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:37.153558 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:37.156991 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:37.161881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d84462d2-05ef-449b-90ef-4338bd8218c4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.272439 Jul 12 13:17:37.164117 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 200/396] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:36 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:37.697089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cdd7ac58-82c9-4c94-9df9-7eccd8440a92 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:37.698409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cdd7ac58-82c9-4c94-9df9-7eccd8440a92 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:37.705690 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdd7ac58-82c9-4c94-9df9-7eccd8440a92 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:37.706529 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdd7ac58-82c9-4c94-9df9-7eccd8440a92 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:37.707639 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdd7ac58-82c9-4c94-9df9-7eccd8440a92 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:37.708285 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdd7ac58-82c9-4c94-9df9-7eccd8440a92 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:37.863942 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-cdd7ac58-82c9-4c94-9df9-7eccd8440a92 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:37.873158 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cdd7ac58-82c9-4c94-9df9-7eccd8440a92 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.180389 Jul 12 13:17:37.875071 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 197/397] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:37 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:38.185230 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:38.187565 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:38.196045 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:38.196823 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:38.197844 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:38.198251 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:38.502042 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:38.522999 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-a65d66a5-0a6d-458e-8a25-36c27540a4fc req-6c0d9eb5-cf88-4373-af40-f029487ca8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d99dc0b-1835-4e7b-816b-2315dbe1a12a", "tag": "b093819a-294c-4c02-8673-aaec05b9bd6a"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:38.532914 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-a65d66a5-0a6d-458e-8a25-36c27540a4fc req-6c0d9eb5-cf88-4373-af40-f029487ca8f3 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:38.533486 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-a65d66a5-0a6d-458e-8a25-36c27540a4fc req-6c0d9eb5-cf88-4373-af40-f029487ca8f3 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:38.545362 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-a65d66a5-0a6d-458e-8a25-36c27540a4fc req-6c0d9eb5-cf88-4373-af40-f029487ca8f3 service nova] Creating event network-changed:b093819a-294c-4c02-8673-aaec05b9bd6a for instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a on hv-cinder-79760 Jul 12 13:17:38.548716 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:38.551353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:38.552629 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-911faa72-a2d4-4535-93f7-674c65b5361c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.371703 Jul 12 13:17:38.554128 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-a65d66a5-0a6d-458e-8a25-36c27540a4fc req-6c0d9eb5-cf88-4373-af40-f029487ca8f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035047 Jul 12 13:17:38.555143 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 198/398] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:17:38.564544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 201/399] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:38 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:38.897584 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b9f13dbd-93dc-4848-b4da-d886521acdcc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:38.903369 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b9f13dbd-93dc-4848-b4da-d886521acdcc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:38.921026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9f13dbd-93dc-4848-b4da-d886521acdcc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:38.921575 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9f13dbd-93dc-4848-b4da-d886521acdcc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:38.922389 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9f13dbd-93dc-4848-b4da-d886521acdcc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:38.922822 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9f13dbd-93dc-4848-b4da-d886521acdcc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:39.126852 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b9f13dbd-93dc-4848-b4da-d886521acdcc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:39.136957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b9f13dbd-93dc-4848-b4da-d886521acdcc tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.248413 Jul 12 13:17:39.138778 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 199/400] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:38 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:39.572586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:39.573828 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:39.580948 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:39.581640 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:39.582586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:39.585532 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:39.886633 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:39.905378 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:39.909148 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:39.912337 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-24343ae5-014e-42de-8e85-530d8bece22d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.343923 Jul 12 13:17:39.916690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 202/401] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:39 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:40.167745 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cdbc29b8-b3b9-4c72-aa1d-1873f5d37cb6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:40.169024 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cdbc29b8-b3b9-4c72-aa1d-1873f5d37cb6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:40.185175 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdbc29b8-b3b9-4c72-aa1d-1873f5d37cb6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:40.185904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdbc29b8-b3b9-4c72-aa1d-1873f5d37cb6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:40.186851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdbc29b8-b3b9-4c72-aa1d-1873f5d37cb6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:40.187624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cdbc29b8-b3b9-4c72-aa1d-1873f5d37cb6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:40.257316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:40.395590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=8 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:40.449085 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-cdbc29b8-b3b9-4c72-aa1d-1873f5d37cb6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:40.459500 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cdbc29b8-b3b9-4c72-aa1d-1873f5d37cb6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.306198 Jul 12 13:17:40.465595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 200/402] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:40 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:40.938284 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:40.940285 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:40.952124 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:40.952909 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:40.953896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:40.954556 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:41.137574 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:41.148216 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:41.149711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:41.150878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2386c4f0-3914-499c-8970-bc179d9228b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.218856 Jul 12 13:17:41.161758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 203/403] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:40 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:41.477710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a49e160a-655b-44d1-8755-6ea836b1a6e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:41.478836 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a49e160a-655b-44d1-8755-6ea836b1a6e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:41.487876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a49e160a-655b-44d1-8755-6ea836b1a6e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:41.489118 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a49e160a-655b-44d1-8755-6ea836b1a6e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:41.490330 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a49e160a-655b-44d1-8755-6ea836b1a6e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:41.490965 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a49e160a-655b-44d1-8755-6ea836b1a6e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:41.679304 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a49e160a-655b-44d1-8755-6ea836b1a6e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:41.693184 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a49e160a-655b-44d1-8755-6ea836b1a6e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.218519 Jul 12 13:17:41.695269 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 201/404] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:41 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:42.170083 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:42.170696 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:42.180771 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:42.181493 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:42.182584 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:42.183112 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:42.307621 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-3c958cf9-4a9d-4080-af21-eb6028ff46f1 req-8420fd84-7151-4756-89ce-5ee8df2c79e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7df43b-4b7b-46af-ad37-d0267407bff2", "name": "network-vif-plugged", "status": "completed", "tag": "2a046eef-1dcf-44d2-be29-2ae216e4b855"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:42.321922 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-3c958cf9-4a9d-4080-af21-eb6028ff46f1 req-8420fd84-7151-4756-89ce-5ee8df2c79e1 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:42.322873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-3c958cf9-4a9d-4080-af21-eb6028ff46f1 req-8420fd84-7151-4756-89ce-5ee8df2c79e1 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:42.346429 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-3c958cf9-4a9d-4080-af21-eb6028ff46f1 req-8420fd84-7151-4756-89ce-5ee8df2c79e1 service nova] Creating event network-vif-plugged:2a046eef-1dcf-44d2-be29-2ae216e4b855 for instance bd7df43b-4b7b-46af-ad37-d0267407bff2 on hv-cinder-79760 Jul 12 13:17:42.352547 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-3c958cf9-4a9d-4080-af21-eb6028ff46f1 req-8420fd84-7151-4756-89ce-5ee8df2c79e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049793 Jul 12 13:17:42.353640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 202/405] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:42.711475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-29b3f2a1-1354-43b6-8f0e-eb81228bcbf3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:42.713236 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-29b3f2a1-1354-43b6-8f0e-eb81228bcbf3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:42.729578 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29b3f2a1-1354-43b6-8f0e-eb81228bcbf3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:42.730288 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29b3f2a1-1354-43b6-8f0e-eb81228bcbf3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:42.731347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29b3f2a1-1354-43b6-8f0e-eb81228bcbf3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:42.731963 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-29b3f2a1-1354-43b6-8f0e-eb81228bcbf3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:42.851182 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:42.865699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:42.868115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:42.874608 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fae63ada-9277-4fe8-8a76-1b67d8eea8d6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.708420 Jul 12 13:17:42.894063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 204/406] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:42 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:42.928794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-29b3f2a1-1354-43b6-8f0e-eb81228bcbf3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:42.938254 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-29b3f2a1-1354-43b6-8f0e-eb81228bcbf3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.230706 Jul 12 13:17:42.938814 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 203/407] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:42 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:17:43.894434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:43.895031 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:43.902379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:43.902831 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:43.903634 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:43.904060 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:43.958797 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0912db3e-b0ed-4f73-ae01-17de0079ab4c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:43.959755 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0912db3e-b0ed-4f73-ae01-17de0079ab4c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:43.967730 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0912db3e-b0ed-4f73-ae01-17de0079ab4c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:43.968379 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0912db3e-b0ed-4f73-ae01-17de0079ab4c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:43.969251 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0912db3e-b0ed-4f73-ae01-17de0079ab4c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:43.970134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0912db3e-b0ed-4f73-ae01-17de0079ab4c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:44.176188 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:44.180521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:44.181637 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0912db3e-b0ed-4f73-ae01-17de0079ab4c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:44.192170 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:44.194281 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:44.195728 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bc2d1bc5-9743-4376-9c53-b0864a90223d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1738 microversion: 2.20 time: 0.305991 Jul 12 13:17:44.195994 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0912db3e-b0ed-4f73-ae01-17de0079ab4c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.244349 Jul 12 13:17:44.196594 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 204/408] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:43 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:44.208585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 205/409] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:43 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:45.218382 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c2db3b3a-9f65-48ac-b007-2fb7fc984e13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:45.220576 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:45.221676 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c2db3b3a-9f65-48ac-b007-2fb7fc984e13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:45.222427 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:45.236178 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c2db3b3a-9f65-48ac-b007-2fb7fc984e13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:45.237975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c2db3b3a-9f65-48ac-b007-2fb7fc984e13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:45.238777 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c2db3b3a-9f65-48ac-b007-2fb7fc984e13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:45.239223 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c2db3b3a-9f65-48ac-b007-2fb7fc984e13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:45.244115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:45.244541 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:45.245604 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:45.246207 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:45.391854 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c2db3b3a-9f65-48ac-b007-2fb7fc984e13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:45.399541 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c2db3b3a-9f65-48ac-b007-2fb7fc984e13 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1371 microversion: 2.1 time: 0.190250 Jul 12 13:17:45.409023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 205/410] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:45 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:45.502904 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:45.513205 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:45.515742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:45.517208 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-26a7529a-98cc-4ceb-be42-76db31c309cb tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1720 microversion: 2.20 time: 0.305532 Jul 12 13:17:45.519488 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 206/411] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:45 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1720 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:46.419328 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a2da8372-9eae-48c5-95da-13af1a70df8c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:46.420991 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a2da8372-9eae-48c5-95da-13af1a70df8c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:46.430508 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:46.432914 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2da8372-9eae-48c5-95da-13af1a70df8c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:46.434389 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2da8372-9eae-48c5-95da-13af1a70df8c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:46.436283 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2da8372-9eae-48c5-95da-13af1a70df8c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:46.436987 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2da8372-9eae-48c5-95da-13af1a70df8c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:46.535917 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:46.539591 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:46.548241 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:46.548940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:46.549858 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:46.550358 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:46.663702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a2da8372-9eae-48c5-95da-13af1a70df8c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:46.675030 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a2da8372-9eae-48c5-95da-13af1a70df8c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1565 microversion: 2.1 time: 0.261890 Jul 12 13:17:46.675960 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 206/412] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:17:46 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1565 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:17:46.695501 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-15d7bbe0-69aa-4520-ae7e-e34e5f107fab tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:46.697821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-15d7bbe0-69aa-4520-ae7e-e34e5f107fab tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:46.706878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-15d7bbe0-69aa-4520-ae7e-e34e5f107fab tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:46.707983 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-15d7bbe0-69aa-4520-ae7e-e34e5f107fab tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:46.709007 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-15d7bbe0-69aa-4520-ae7e-e34e5f107fab tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:46.709404 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-15d7bbe0-69aa-4520-ae7e-e34e5f107fab tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:46.722210 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:46.736711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:46.738880 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:46.740950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2c075f70-de88-4a9b-b2fb-6285b5cc843c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1720 microversion: 2.20 time: 0.209852 Jul 12 13:17:46.751849 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 207/413] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:46 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:46.875726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-15d7bbe0-69aa-4520-ae7e-e34e5f107fab tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187013 Jul 12 13:17:46.876687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 207/414] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 12 13:17:46 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:47.759806 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:47.760403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:47.769978 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:47.769978 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:47.771351 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:47.771351 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:47.949568 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:47.961720 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:47.963618 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:47.964938 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0ccf6c84-17b5-4fee-8163-cf40fa739b57 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1720 microversion: 2.20 time: 0.209625 Jul 12 13:17:47.966074 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 208/415] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:47 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:48.009858 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-73c74bc4-8f30-45c4-9c87-005bacd678b9 req-60c1b9ed-2dc6-4eb7-b1bc-62eaaae907ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a8f841-941e-4a72-a5c0-66cf4c1f7ebc", "name": "network-vif-unplugged", "status": "completed", "tag": "aecd26f4-285f-454f-8ddb-ecfc55407ec5"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:48.029912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-73c74bc4-8f30-45c4-9c87-005bacd678b9 req-60c1b9ed-2dc6-4eb7-b1bc-62eaaae907ed service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:48.030863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-73c74bc4-8f30-45c4-9c87-005bacd678b9 req-60c1b9ed-2dc6-4eb7-b1bc-62eaaae907ed service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:48.050153 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-73c74bc4-8f30-45c4-9c87-005bacd678b9 req-60c1b9ed-2dc6-4eb7-b1bc-62eaaae907ed service nova] Creating event network-vif-unplugged:aecd26f4-285f-454f-8ddb-ecfc55407ec5 for instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc on hv-cinder-79760 Jul 12 13:17:48.057046 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-73c74bc4-8f30-45c4-9c87-005bacd678b9 req-60c1b9ed-2dc6-4eb7-b1bc-62eaaae907ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051905 Jul 12 13:17:48.058313 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 208/416] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:48.987230 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:48.989247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:49.004798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:49.005732 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:49.007015 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:49.008034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:49.013605 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-f2b28e14-cb4b-4b6d-9508-dee2e1eaf615 req-8f5e953d-f95e-4970-a983-105b00ffbaec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7df43b-4b7b-46af-ad37-d0267407bff2", "tag": "2a046eef-1dcf-44d2-be29-2ae216e4b855"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:49.029481 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-f2b28e14-cb4b-4b6d-9508-dee2e1eaf615 req-8f5e953d-f95e-4970-a983-105b00ffbaec service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:49.031846 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-f2b28e14-cb4b-4b6d-9508-dee2e1eaf615 req-8f5e953d-f95e-4970-a983-105b00ffbaec service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:49.062612 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-f2b28e14-cb4b-4b6d-9508-dee2e1eaf615 req-8f5e953d-f95e-4970-a983-105b00ffbaec service nova] Creating event network-changed:2a046eef-1dcf-44d2-be29-2ae216e4b855 for instance bd7df43b-4b7b-46af-ad37-d0267407bff2 on hv-cinder-79760 Jul 12 13:17:49.076269 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-f2b28e14-cb4b-4b6d-9508-dee2e1eaf615 req-8f5e953d-f95e-4970-a983-105b00ffbaec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067005 Jul 12 13:17:49.077339 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 209/417] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:49.236420 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:49.246196 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:49.247860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:49.249358 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5f07ace4-c554-48d0-8c5d-31faa93413b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1720 microversion: 2.20 time: 0.269741 Jul 12 13:17:49.262248 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 209/418] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:48 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:50.269787 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:50.271161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:50.278721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:50.279421 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:50.280376 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:50.280954 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:50.546753 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:50.562736 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:50.578712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:50.580018 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-99734aa8-17fa-41a7-a5d9-bad26a8a72e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1720 microversion: 2.20 time: 0.315310 Jul 12 13:17:50.580589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 210/419] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:50 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1720 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:51.598027 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:51.598760 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:51.607007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:51.607683 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:51.608664 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:51.609284 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:51.820586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:51.834044 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:51.837219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:51.838727 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f655634f-5f45-4f3b-a3a8-f00d5dc36ef1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1720 microversion: 2.20 time: 0.244878 Jul 12 13:17:51.839655 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 210/420] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:51 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1720 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:52.811959 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-be17613b-7afd-4318-aa8a-db6db143100b tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Action: 'create', calling method: .version_select at 0x7fd48d142670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1629722949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa9drRX8aiNwWXfWEZ4ols/DB2Pr/xpQnd15+ir9yJTyyBuSw5mYL85ebOuhYbGo7ALo/HsHifm8qvqpdS2BmOlQ9kaIVmE4VUDiDnrxvxeV/K6qtHAxlGZSufZHH697g=="}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:52.827656 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-be17613b-7afd-4318-aa8a-db6db143100b tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Getting quotas for project e603fb53b07e43a2b529f59a02f687fc. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:17:52.832945 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-be17613b-7afd-4318-aa8a-db6db143100b tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Getting quotas for user 0d6f70302739437b8d14fc0fd7967dac and project e603fb53b07e43a2b529f59a02f687fc. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:17:52.859895 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:52.866865 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-be17613b-7afd-4318-aa8a-db6db143100b tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.259917 Jul 12 13:17:52.867652 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:52.879222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 211/421] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:17:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:17:52.886622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:52.889869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:52.890820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:52.891787 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:53.196803 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:53.209836 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:53.211889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:53.217582 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-82011bdf-3c6d-41ac-85e1-4e203f4fcba0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1663 microversion: 2.20 time: 0.363700 Jul 12 13:17:53.217889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 211/422] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:52 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1663 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:17:53.238058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a512a043-27aa-4374-8e23-a27c0117c4be tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a6d20ef-7ffa-4f47-9b72-d2c709dd78a0"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:53.239166 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a512a043-27aa-4374-8e23-a27c0117c4be tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:53.249170 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a512a043-27aa-4374-8e23-a27c0117c4be tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:53.249760 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a512a043-27aa-4374-8e23-a27c0117c4be tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:53.250727 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a512a043-27aa-4374-8e23-a27c0117c4be tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:53.251316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a512a043-27aa-4374-8e23-a27c0117c4be tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:53.445745 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:53.552722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a512a043-27aa-4374-8e23-a27c0117c4be tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321230 Jul 12 13:17:53.553535 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 212/423] 10.222.0.33 () {62 vars in 1363 bytes} [Tue Jul 12 13:17:53 2022] POST /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:17:53.676265 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c08a4795-d2ad-4034-8444-e412f5b4d477 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:17:53.676827 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c08a4795-d2ad-4034-8444-e412f5b4d477 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:53.684077 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c08a4795-d2ad-4034-8444-e412f5b4d477 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:53.684747 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c08a4795-d2ad-4034-8444-e412f5b4d477 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:53.685793 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c08a4795-d2ad-4034-8444-e412f5b4d477 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:53.686367 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c08a4795-d2ad-4034-8444-e412f5b4d477 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:53.789293 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c08a4795-d2ad-4034-8444-e412f5b4d477 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/action" status: 202 len: 0 microversion: 2.20 time: 0.116986 Jul 12 13:17:53.789930 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 212/424] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 12 13:17:53 2022] POST /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:17:53.798693 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:53.799332 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:53.809462 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:53.809853 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:53.810696 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:53.811145 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:54.272402 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:54.283135 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:54.284864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:54.287005 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c89e6bf0-92ac-4119-a069-1b7d275c47f0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1749 microversion: 2.20 time: 0.492392 Jul 12 13:17:54.288229 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 213/425] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:53 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1749 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:55.309572 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:55.311263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:55.314022 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=66 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:17:55.328847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:55.340600 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:55.344347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:55.345237 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:55.488174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:55.503162 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:55.504670 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:55.505834 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-858c1230-7d59-45d8-bb6a-5a98f0adf910 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1749 microversion: 2.20 time: 0.203545 Jul 12 13:17:55.506388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 213/426] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:55 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1749 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:56.524557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:56.525242 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:56.533142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:56.533894 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:56.534715 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:56.535161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:56.678999 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:56.688029 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:56.690344 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:56.691704 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3e1148bc-f37e-40d9-948a-edc1e7ace7f9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1751 microversion: 2.20 time: 0.171315 Jul 12 13:17:56.692490 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 214/427] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:56 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:57.712916 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:57.713498 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:57.721288 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:57.721733 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:57.722499 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:57.722934 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:57.867623 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:57.876677 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:57.878169 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:57.879351 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0d9e0136-f39a-494f-8cea-2bbaa8e852b1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.171797 Jul 12 13:17:57.879915 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 214/428] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:57 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:17:58.897521 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:17:58.898141 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:17:58.904789 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:58.905353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:58.906115 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:17:58.906542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:17:59.045252 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:59.054823 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:59.056328 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:17:59.057471 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-84e554e3-ab62-46e7-85fe-da58cc9b8c2a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.163930 Jul 12 13:17:59.058050 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 215/429] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:17:58 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:00.077023 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:00.077632 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:00.085458 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:00.085916 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:00.087248 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:00.087671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:00.242015 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:00.251124 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:00.253471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:00.256050 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2d27b294-7d7c-4388-9184-e88894f22818 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.182591 Jul 12 13:18:00.256627 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 215/430] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:00 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:01.276041 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:01.276624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:01.284054 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:01.284577 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:01.285614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:01.286650 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:01.472225 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:01.495088 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:01.496743 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:01.498010 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-eccf743a-148d-4733-b5aa-88dca73b73e1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.226413 Jul 12 13:18:01.498648 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 216/431] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:01 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:02.518739 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:02.522263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:02.530860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:02.531788 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:02.532747 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:02.533507 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:02.758979 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:02.770946 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:02.772975 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:02.775347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6f0796e8-cc51-4c7e-b6d4-0825378e5e98 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.262496 Jul 12 13:18:02.777374 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 216/432] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:02 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:03.795594 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:03.796154 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:03.798463 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=4 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:03.804324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:03.804770 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:03.805541 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:03.805972 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:03.975686 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:03.985759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:03.987395 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:03.988608 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b66d5bcb-89da-4c33-bc90-b45c262d1b9d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.197625 Jul 12 13:18:04.000871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 217/433] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:03 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:05.029676 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:05.030403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:05.038813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:05.039402 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:05.040207 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:05.040636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:05.187247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:05.199050 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:05.200860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:05.202631 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-37e0c5e3-1d5e-4599-bd25-573077a83336 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.191205 Jul 12 13:18:05.203766 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 217/434] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:05 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:05.820095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-15e99a02-56cc-498b-ba01-0f2c1a4eb4e2 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:05.820651 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-15e99a02-56cc-498b-ba01-0f2c1a4eb4e2 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:05.827487 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-15e99a02-56cc-498b-ba01-0f2c1a4eb4e2 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:05.827929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-15e99a02-56cc-498b-ba01-0f2c1a4eb4e2 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:05.828673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-15e99a02-56cc-498b-ba01-0f2c1a4eb4e2 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:05.829092 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-15e99a02-56cc-498b-ba01-0f2c1a4eb4e2 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:05.978446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-15e99a02-56cc-498b-ba01-0f2c1a4eb4e2 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lazy-loading 'services' on Instance uuid bfa0d215-6475-4c82-9e86-901a21c75155 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:18:06.106356 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-15e99a02-56cc-498b-ba01-0f2c1a4eb4e2 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155/os-volume_attachments/9b27a8db-c547-4ef3-98f6-038f136cd3dc" status: 202 len: 0 microversion: 2.1 time: 0.290408 Jul 12 13:18:06.107123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 218/435] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:18:05 2022] DELETE /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155/os-volume_attachments/9b27a8db-c547-4ef3-98f6-038f136cd3dc => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:18:06.223288 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:06.223876 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:06.230815 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:06.231298 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:06.232060 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:06.232479 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:06.388329 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:06.398324 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:06.400386 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:06.401570 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-acad6708-2253-4fb4-b015-93ecbd505250 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.182667 Jul 12 13:18:06.402127 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 218/436] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:06 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:18:07.425610 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:07.426744 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:07.435863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:07.436276 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:07.437100 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:07.437511 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:07.606932 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:07.624975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:07.626699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:07.627926 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d0dcafca-f126-4e72-a6bc-47d0b35dc547 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.209656 Jul 12 13:18:07.638819 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 219/437] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:07 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:08.646671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:08.646671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:08.653158 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:08.654724 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:08.654724 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:08.654724 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:08.810179 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:08.819692 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:08.821746 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:08.823615 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cf15c7d7-c11f-4441-aeda-0fbfb6f541d9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.181934 Jul 12 13:18:08.824803 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 219/438] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:08 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:09.846811 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:09.848947 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:09.856764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:09.857476 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:09.858484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:09.858887 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:10.000285 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:10.009495 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:10.011351 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:10.012781 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-1d8458b7-e9fa-4c9f-b6e1-8d33f59e6e64 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.172601 Jul 12 13:18:10.023608 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 220/439] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:09 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:11.030546 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:11.031224 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:11.037729 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:11.038168 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:11.039235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:11.039670 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:11.176114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:11.185019 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:11.186515 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:11.187692 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-05fd2293-5553-4d3b-9ae9-f3c296806830 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.161116 Jul 12 13:18:11.188286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 220/440] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:11 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:12.213084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:12.213774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:12.226685 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:12.226685 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:12.226685 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:12.226685 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:12.381472 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:12.390363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:12.391888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:12.393037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-94d01523-6d1f-4c6f-9640-5f1ce921b847 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.189993 Jul 12 13:18:12.393567 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 221/441] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:12 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:13.414103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:13.414802 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:13.423307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:13.423671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:13.424409 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:13.425044 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:13.447108 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:13.572568 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:13.581591 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:13.583101 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:13.584249 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4a36615e-4d36-45ec-b6a8-ff1be745dfe0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.175021 Jul 12 13:18:13.584800 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 221/442] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:13 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:14.609422 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:14.610363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:14.619727 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:14.620176 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:14.620934 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:14.621364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:14.756323 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:14.764969 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:14.766477 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:14.767646 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a4d34452-d646-4b5e-9d77-272870a7393a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.167153 Jul 12 13:18:14.768202 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 222/443] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:14 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:15.790270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:15.791415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:15.803123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:15.803916 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:15.805486 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:15.806270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:15.942638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:15.952204 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:15.953697 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:15.954856 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bdc3679b-879b-4b22-9cf7-65ab1e29adf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.172104 Jul 12 13:18:15.955437 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 222/444] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:15 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:16.973900 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:16.974493 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:16.977282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:16.983352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:16.983801 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:16.984564 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:16.984992 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:17.121965 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:17.130793 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:17.132244 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:17.133632 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-74331822-b12e-4e1c-aada-a3cb98301d63 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.163703 Jul 12 13:18:17.134179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 223/445] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:16 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:17.878984 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a743ff88-826c-486c-978d-4a28fcc9fcfd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:17.879637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a743ff88-826c-486c-978d-4a28fcc9fcfd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:17.886873 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a743ff88-826c-486c-978d-4a28fcc9fcfd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:17.887436 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a743ff88-826c-486c-978d-4a28fcc9fcfd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:17.888194 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a743ff88-826c-486c-978d-4a28fcc9fcfd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:17.888625 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a743ff88-826c-486c-978d-4a28fcc9fcfd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:17.917122 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a743ff88-826c-486c-978d-4a28fcc9fcfd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:18:18.007169 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a743ff88-826c-486c-978d-4a28fcc9fcfd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 204 len: 0 microversion: 2.1 time: 0.132549 Jul 12 13:18:18.007718 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 223/446] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:18:17 2022] DELETE /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:18:18.017624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-951ce0ed-6455-4140-a55b-76c0e839d0d8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:18.018206 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-951ce0ed-6455-4140-a55b-76c0e839d0d8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:18.025231 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-951ce0ed-6455-4140-a55b-76c0e839d0d8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:18.025666 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-951ce0ed-6455-4140-a55b-76c0e839d0d8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:18.026419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-951ce0ed-6455-4140-a55b-76c0e839d0d8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:18.026845 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-951ce0ed-6455-4140-a55b-76c0e839d0d8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:18.161158 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:18.162003 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:18.169721 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:18.170280 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:18.171091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:18.171513 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:18.172958 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-951ce0ed-6455-4140-a55b-76c0e839d0d8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:18.183557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-951ce0ed-6455-4140-a55b-76c0e839d0d8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1514 microversion: 2.1 time: 0.170961 Jul 12 13:18:18.184328 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 224/447] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:18 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:18.263353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-208543960", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1629722949", "security_groups": [{"name": "tempest-secgroup-smoke-683362428"}], "block_device_mapping_v2": [{"uuid": "76e44206-8630-42e6-b6c0-d9f1656c9011", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "04848669-0add-4a7f-9670-bf6780611a41"}]}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:18.319695 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:18.328929 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:18.330471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:18.331661 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9a8caa25-c8ff-4285-b88f-7c09bee58c24 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.184405 Jul 12 13:18:18.332222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 224/448] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:18 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:18:18.384518 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] validate_networks() for [('04848669-0add-4a7f-9670-bf6780611a41', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:18:18.838170 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:18:18.838784 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:18:18.839376 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:18:18.839798 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:18:18.840227 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:18:18.852013 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:18.852850 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:18.853736 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:18.854285 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:18.873354 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Getting quotas for project e603fb53b07e43a2b529f59a02f687fc. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:18:18.877822 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Getting quotas for user 0d6f70302739437b8d14fc0fd7967dac and project e603fb53b07e43a2b529f59a02f687fc. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:18:18.951829 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:18:18.953936 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76e44206-8630-42e6-b6c0-d9f1656c9011',volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:18:19.133918 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-bf04cedd-0916-4755-90f2-82fd7c3151ca tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.873942 Jul 12 13:18:19.134728 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 225/449] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:18:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:18:19.146307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-943102c1-2c50-4a81-83a3-474a55c2a772 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:19.146901 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-943102c1-2c50-4a81-83a3-474a55c2a772 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:19.203774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7b302a93-0840-40da-846a-dcb559ceb57a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:19.204411 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7b302a93-0840-40da-846a-dcb559ceb57a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:19.211459 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-943102c1-2c50-4a81-83a3-474a55c2a772 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:19.212716 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b302a93-0840-40da-846a-dcb559ceb57a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:19.213238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b302a93-0840-40da-846a-dcb559ceb57a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:19.215311 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b302a93-0840-40da-846a-dcb559ceb57a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:19.216070 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b302a93-0840-40da-846a-dcb559ceb57a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:19.222106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-943102c1-2c50-4a81-83a3-474a55c2a772 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1094 microversion: 2.1 time: 0.079808 Jul 12 13:18:19.223373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 225/450] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:19 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:19.351190 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:19.351797 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:19.359273 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:19.359805 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:19.360637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:19.361387 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:19.371318 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7b302a93-0840-40da-846a-dcb559ceb57a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:19.379935 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7b302a93-0840-40da-846a-dcb559ceb57a tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1514 microversion: 2.1 time: 0.182780 Jul 12 13:18:19.380655 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 226/451] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:19 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:19.506814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:19.516498 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:19.518031 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:19.519231 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9cae2c5b-781a-4e83-8520-c205c7d08912 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.172048 Jul 12 13:18:19.519796 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 226/452] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:19 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:18:20.243344 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-acb9d7b2-3042-4a04-94cb-370194ff023f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:20.244007 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-acb9d7b2-3042-4a04-94cb-370194ff023f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:20.254031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acb9d7b2-3042-4a04-94cb-370194ff023f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:20.254551 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acb9d7b2-3042-4a04-94cb-370194ff023f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:20.255724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acb9d7b2-3042-4a04-94cb-370194ff023f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:20.256261 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acb9d7b2-3042-4a04-94cb-370194ff023f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:20.333211 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-acb9d7b2-3042-4a04-94cb-370194ff023f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:20.336624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:20.341917 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-acb9d7b2-3042-4a04-94cb-370194ff023f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1192 microversion: 2.1 time: 0.104508 Jul 12 13:18:20.342476 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 227/453] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:20 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:20.400151 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c9c18b69-4016-499e-8071-7d107a187ea9 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:20.401240 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c9c18b69-4016-499e-8071-7d107a187ea9 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:20.412165 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9c18b69-4016-499e-8071-7d107a187ea9 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:20.412902 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9c18b69-4016-499e-8071-7d107a187ea9 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:20.414153 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9c18b69-4016-499e-8071-7d107a187ea9 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:20.414860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9c18b69-4016-499e-8071-7d107a187ea9 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:20.537940 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:20.538634 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:20.546480 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:20.546921 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:20.547706 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:20.548134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:20.560102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c9c18b69-4016-499e-8071-7d107a187ea9 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:20.567818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c9c18b69-4016-499e-8071-7d107a187ea9 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1514 microversion: 2.1 time: 0.174245 Jul 12 13:18:20.568380 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 227/454] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:20 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:20.682416 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:20.692168 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:20.693643 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:20.694785 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3c548b30-d2a3-4094-bd39-cdc28cc7c63f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.160897 Jul 12 13:18:20.695371 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 228/455] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:20 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:21.149684 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-fdce7e8e-dabc-4626-9751-acc957cbc3bd req-1a0ec18d-430f-470a-80ef-8b117fab930f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa0d215-6475-4c82-9e86-901a21c75155", "name": "network-vif-deleted", "tag": "d3c7813f-d3b4-43bd-8dbc-1de1569546c5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:21.158549 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-fdce7e8e-dabc-4626-9751-acc957cbc3bd req-1a0ec18d-430f-470a-80ef-8b117fab930f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:21.158999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-fdce7e8e-dabc-4626-9751-acc957cbc3bd req-1a0ec18d-430f-470a-80ef-8b117fab930f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:21.170780 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-fdce7e8e-dabc-4626-9751-acc957cbc3bd req-1a0ec18d-430f-470a-80ef-8b117fab930f service nova] Creating event network-vif-deleted:d3c7813f-d3b4-43bd-8dbc-1de1569546c5 for instance bfa0d215-6475-4c82-9e86-901a21c75155 on hv-cinder-79760 Jul 12 13:18:21.175711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-fdce7e8e-dabc-4626-9751-acc957cbc3bd req-1a0ec18d-430f-470a-80ef-8b117fab930f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029884 Jul 12 13:18:21.176295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 228/456] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:21.362178 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fe65ca16-b17d-40d0-ad21-43a6ec9c0017 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:21.363018 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fe65ca16-b17d-40d0-ad21-43a6ec9c0017 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:21.372163 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fe65ca16-b17d-40d0-ad21-43a6ec9c0017 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:21.372602 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fe65ca16-b17d-40d0-ad21-43a6ec9c0017 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:21.373350 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fe65ca16-b17d-40d0-ad21-43a6ec9c0017 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:21.373772 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fe65ca16-b17d-40d0-ad21-43a6ec9c0017 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:21.434929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fe65ca16-b17d-40d0-ad21-43a6ec9c0017 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:21.442496 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fe65ca16-b17d-40d0-ad21-43a6ec9c0017 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1210 microversion: 2.1 time: 0.086711 Jul 12 13:18:21.443073 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 229/457] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:21 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:21.590063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e119b55a-62fa-4214-88f7-040991c0f782 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:21.590750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e119b55a-62fa-4214-88f7-040991c0f782 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:21.597846 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e119b55a-62fa-4214-88f7-040991c0f782 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:21.598299 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e119b55a-62fa-4214-88f7-040991c0f782 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:21.599055 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e119b55a-62fa-4214-88f7-040991c0f782 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:21.599483 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e119b55a-62fa-4214-88f7-040991c0f782 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:21.671248 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e119b55a-62fa-4214-88f7-040991c0f782 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:21.684176 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e119b55a-62fa-4214-88f7-040991c0f782 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1472 microversion: 2.1 time: 0.100741 Jul 12 13:18:21.685062 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 229/458] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:21 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1472 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:21.713195 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:21.713842 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:21.720088 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:21.720493 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:21.721237 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:21.721657 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:21.855548 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:21.864497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:21.865975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:21.867228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5de904b8-cd58-4b74-8469-cc6605318d75 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.158017 Jul 12 13:18:21.867779 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 230/459] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:21 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:22.460203 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fce2a0e5-e865-4f39-9a0a-161879efc637 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:22.460769 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fce2a0e5-e865-4f39-9a0a-161879efc637 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:22.467287 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fce2a0e5-e865-4f39-9a0a-161879efc637 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:22.467722 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fce2a0e5-e865-4f39-9a0a-161879efc637 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:22.468485 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fce2a0e5-e865-4f39-9a0a-161879efc637 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:22.468914 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fce2a0e5-e865-4f39-9a0a-161879efc637 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:22.555868 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fce2a0e5-e865-4f39-9a0a-161879efc637 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:22.563826 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fce2a0e5-e865-4f39-9a0a-161879efc637 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1210 microversion: 2.1 time: 0.107579 Jul 12 13:18:22.573227 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 230/460] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:22 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:22.707648 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:22.708336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:22.715699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:22.716142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:22.716903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:22.717329 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:22.754324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:22.754760 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:22.755227 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lazy-loading 'fault' on Instance uuid bfa0d215-6475-4c82-9e86-901a21c75155 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:18:22.799455 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:22.810993 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b4bd3ad9-744e-4982-a4b0-9550e403ee4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 200 len: 1309 microversion: 2.1 time: 0.107096 Jul 12 13:18:22.823468 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 231/461] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:22 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:22.898197 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:22.899510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:22.910275 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:22.911022 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:22.911929 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:22.912883 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:23.161182 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:23.171734 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:23.173373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:23.174645 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-78f0fccf-d818-4d72-a036-23ba4afad617 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.284618 Jul 12 13:18:23.175411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 231/462] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:22 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:18:23.542583 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-f26c0ff4-c724-4daa-828a-02c68a20755c req-7c8a0247-7eed-490a-b0ef-f18b649da88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8", "tag": "3c2279a3-7680-4337-9967-279c4c885c20"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:23.551589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-f26c0ff4-c724-4daa-828a-02c68a20755c req-7c8a0247-7eed-490a-b0ef-f18b649da88f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:23.552625 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-f26c0ff4-c724-4daa-828a-02c68a20755c req-7c8a0247-7eed-490a-b0ef-f18b649da88f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:23.567340 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-f26c0ff4-c724-4daa-828a-02c68a20755c req-7c8a0247-7eed-490a-b0ef-f18b649da88f service nova] Creating event network-changed:3c2279a3-7680-4337-9967-279c4c885c20 for instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 on hv-cinder-79760 Jul 12 13:18:23.573303 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-f26c0ff4-c724-4daa-828a-02c68a20755c req-7c8a0247-7eed-490a-b0ef-f18b649da88f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035725 Jul 12 13:18:23.584027 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-66403420-27d2-4fe1-9f70-8c3522be9ce3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:23.584732 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-66403420-27d2-4fe1-9f70-8c3522be9ce3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:23.587095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 232/463] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:23.591779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66403420-27d2-4fe1-9f70-8c3522be9ce3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:23.592247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66403420-27d2-4fe1-9f70-8c3522be9ce3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:23.593054 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66403420-27d2-4fe1-9f70-8c3522be9ce3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:23.593613 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66403420-27d2-4fe1-9f70-8c3522be9ce3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:23.830229 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:23.831136 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: bfa0d215-6475-4c82-9e86-901a21c75155] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:23.838044 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:23.838678 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:23.839395 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-66403420-27d2-4fe1-9f70-8c3522be9ce3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:23.839829 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:23.840424 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:23.848026 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-66403420-27d2-4fe1-9f70-8c3522be9ce3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.270977 Jul 12 13:18:23.848599 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 232/464] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:23 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:23.858638 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] HTTP exception thrown: Instance bfa0d215-6475-4c82-9e86-901a21c75155 could not be found. Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Request method failure captured: Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 HTTP/1.1 Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXRA8Ubzr1qIB0YHhwqOXkV2kpD_7LXR6L00EsB_slJW5cb8QUJjtdK93t5cLqdbKNogF_wKzO2djpAuKxBueY2FmADCsXRd4kjKG6-W4HK-j0Zfp7-l6L6BudKbtYwb-r0nBLdQtntR6so1dy2ofG9TxW1fEMZ6m4LWNapocvmF5jw Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: f8754507111948849d7294602bff56b6 Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesSnapshotTestJSON-799596431 Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:18:23.860378 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8754507111948849d7294602bff56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8754507111948849d7294602bff56b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8754507111948849d7294602bff56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8754507111948849d7294602bff56b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesSnapshotTestJSON-799596431 Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: f8754507111948849d7294602bff56b6 Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-799596431 Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesSnapshotTestJSON-799596431-project Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 37f5a6fae8c9412da7dc2f2c9c5d2069 Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesSnapshotTestJSON-799596431-project Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance bfa0d215-6475-4c82-9e86-901a21c75155 could not be found. Jul 12 13:18:23.861864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': 'bfa0d215-6475-4c82-9e86-901a21c75155'} Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa0d215-6475-4c82-9e86-901a21c75155 could not be found. Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:18:23.862714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa0d215-6475-4c82-9e86-901a21c75155 could not be found. Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa0d215-6475-4c82-9e86-901a21c75155 could not be found. Jul 12 13:18:23.864172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:23.866229 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Returning 404 to user: Instance bfa0d215-6475-4c82-9e86-901a21c75155 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:18:23.866229 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6bec835a-8647-4c66-a9fe-7780568c1dbd tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155" status: 404 len: 111 microversion: 2.1 time: 0.036065 Jul 12 13:18:23.866229 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 233/465] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:23 2022] GET /compute/v2.1/servers/bfa0d215-6475-4c82-9e86-901a21c75155 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:18:24.193608 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:24.194210 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:24.200864 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:24.201300 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:24.202066 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:24.202502 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:24.620184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:24.629151 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:24.630640 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:24.631805 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9e910654-7384-475d-af31-6c8ffd319526 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.442244 Jul 12 13:18:24.632376 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 233/466] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:24 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:24.869955 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1c902a98-b3b1-4981-be00-89efee386acc tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:24.870851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-1c902a98-b3b1-4981-be00-89efee386acc tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:24.882512 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1c902a98-b3b1-4981-be00-89efee386acc tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:24.883389 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1c902a98-b3b1-4981-be00-89efee386acc tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:24.884879 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1c902a98-b3b1-4981-be00-89efee386acc tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:24.885344 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1c902a98-b3b1-4981-be00-89efee386acc tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:25.023840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-1c902a98-b3b1-4981-be00-89efee386acc tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:25.036369 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-1c902a98-b3b1-4981-be00-89efee386acc tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.173312 Jul 12 13:18:25.037312 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 234/467] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:24 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:25.655355 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:25.656347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:25.660084 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:25.668325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:25.668768 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:25.669532 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:25.669959 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:25.810607 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:25.823915 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:25.826226 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:25.828110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3e3bb92f-5ab7-49cf-934a-4f56bf309f27 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.179788 Jul 12 13:18:25.828889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 234/468] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:25 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:26.057689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8740365e-41a4-4686-87f0-ef1d19ce476e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:26.058276 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8740365e-41a4-4686-87f0-ef1d19ce476e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:26.065231 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8740365e-41a4-4686-87f0-ef1d19ce476e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:26.065703 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8740365e-41a4-4686-87f0-ef1d19ce476e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:26.066431 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8740365e-41a4-4686-87f0-ef1d19ce476e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:26.066864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8740365e-41a4-4686-87f0-ef1d19ce476e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:26.216854 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8740365e-41a4-4686-87f0-ef1d19ce476e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:26.224676 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8740365e-41a4-4686-87f0-ef1d19ce476e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.173510 Jul 12 13:18:26.225206 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 235/469] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:26 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:26.856124 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:26.856770 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:26.863960 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:26.864449 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:26.865285 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:26.865767 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:27.003334 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:27.012294 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:27.013773 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:27.014991 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-acf771d5-7d2f-4a45-a1c3-e40b713e59d1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.165041 Jul 12 13:18:27.015556 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 235/470] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:26 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:27.241909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4ec63c80-d5e7-4b54-bb3d-1bfd228ae167 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:27.242510 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4ec63c80-d5e7-4b54-bb3d-1bfd228ae167 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:27.250063 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ec63c80-d5e7-4b54-bb3d-1bfd228ae167 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:27.250501 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ec63c80-d5e7-4b54-bb3d-1bfd228ae167 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:27.251295 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ec63c80-d5e7-4b54-bb3d-1bfd228ae167 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:27.251726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4ec63c80-d5e7-4b54-bb3d-1bfd228ae167 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:27.387880 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4ec63c80-d5e7-4b54-bb3d-1bfd228ae167 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:27.395593 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4ec63c80-d5e7-4b54-bb3d-1bfd228ae167 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.157559 Jul 12 13:18:27.396132 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 236/471] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:27 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:27.975779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-bba5ef36-c7ae-491d-aa91-f83edb0b21a3 req-7f7efb96-1876-42e4-a70e-eae2c7125d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a8f841-941e-4a72-a5c0-66cf4c1f7ebc", "name": "network-vif-plugged", "status": "completed", "tag": "aecd26f4-285f-454f-8ddb-ecfc55407ec5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:27.984787 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-bba5ef36-c7ae-491d-aa91-f83edb0b21a3 req-7f7efb96-1876-42e4-a70e-eae2c7125d09 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:27.985219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-bba5ef36-c7ae-491d-aa91-f83edb0b21a3 req-7f7efb96-1876-42e4-a70e-eae2c7125d09 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:27.997085 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-bba5ef36-c7ae-491d-aa91-f83edb0b21a3 req-7f7efb96-1876-42e4-a70e-eae2c7125d09 service nova] Creating event network-vif-plugged:aecd26f4-285f-454f-8ddb-ecfc55407ec5 for instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc on hv-cinder-79760 Jul 12 13:18:28.002045 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-bba5ef36-c7ae-491d-aa91-f83edb0b21a3 req-7f7efb96-1876-42e4-a70e-eae2c7125d09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029909 Jul 12 13:18:28.002645 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 236/472] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:28.037734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:28.038347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:28.044972 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:28.045611 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:28.046384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:28.046813 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:28.197303 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:28.207514 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:28.209179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:28.210479 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-80796304-3bcc-4039-9f0d-98d83bfceaf2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.176699 Jul 12 13:18:28.211496 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 237/473] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:28 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:28.416331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6e4b0d79-3acc-4909-9079-aa541cc30aec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:28.417549 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6e4b0d79-3acc-4909-9079-aa541cc30aec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:28.424101 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e4b0d79-3acc-4909-9079-aa541cc30aec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:28.424541 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e4b0d79-3acc-4909-9079-aa541cc30aec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:28.425303 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e4b0d79-3acc-4909-9079-aa541cc30aec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:28.425734 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6e4b0d79-3acc-4909-9079-aa541cc30aec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:28.570740 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6e4b0d79-3acc-4909-9079-aa541cc30aec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:28.578674 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6e4b0d79-3acc-4909-9079-aa541cc30aec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.169062 Jul 12 13:18:28.579282 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 237/474] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:28 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:29.229402 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:29.229959 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:29.232242 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:29.233014 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=6 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:29.239858 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:29.240293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:29.241043 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:29.241456 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:29.372895 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:29.381683 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:29.383242 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:29.384363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cb9336bb-3446-4b14-8118-114deb90c086 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.158938 Jul 12 13:18:29.384888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 238/475] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:29 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:29.597609 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-926c2e50-d77b-4912-8357-a7d7100deae9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:29.598974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-926c2e50-d77b-4912-8357-a7d7100deae9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:29.601404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:29.607427 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-926c2e50-d77b-4912-8357-a7d7100deae9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:29.607967 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-926c2e50-d77b-4912-8357-a7d7100deae9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:29.609080 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-926c2e50-d77b-4912-8357-a7d7100deae9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:29.609506 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-926c2e50-d77b-4912-8357-a7d7100deae9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:29.742593 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-926c2e50-d77b-4912-8357-a7d7100deae9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:29.746055 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:29.752282 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-926c2e50-d77b-4912-8357-a7d7100deae9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.159760 Jul 12 13:18:29.752787 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 238/476] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:29 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:30.406786 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:30.407838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:30.419785 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:30.420222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:30.420977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:30.421397 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:30.556411 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:30.569345 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:30.571328 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:30.573091 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8267ff7f-bdd8-464b-b1d6-c0f28d58326a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.172813 Jul 12 13:18:30.573811 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 239/477] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:30 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:30.771071 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4ae32132-c0e8-4779-9af9-9a1c54fe90bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:30.771683 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4ae32132-c0e8-4779-9af9-9a1c54fe90bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:30.780985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4ae32132-c0e8-4779-9af9-9a1c54fe90bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:30.781423 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4ae32132-c0e8-4779-9af9-9a1c54fe90bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:30.782176 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4ae32132-c0e8-4779-9af9-9a1c54fe90bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:30.782599 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4ae32132-c0e8-4779-9af9-9a1c54fe90bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:30.924305 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4ae32132-c0e8-4779-9af9-9a1c54fe90bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:30.935544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4ae32132-c0e8-4779-9af9-9a1c54fe90bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.169671 Jul 12 13:18:30.936114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 239/478] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:30 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:31.596631 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:31.597613 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:31.608553 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:31.609273 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:31.610511 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:31.611266 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:31.756004 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:31.767141 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:31.768621 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:31.769760 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-61bc0876-50a2-43ca-ae19-1ca5e0f4c375 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.180005 Jul 12 13:18:31.770316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 240/479] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:31 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:31.955436 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-686cb445-036a-4850-833c-0520cbdea67a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:31.956122 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-686cb445-036a-4850-833c-0520cbdea67a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:31.964695 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-686cb445-036a-4850-833c-0520cbdea67a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:31.965257 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-686cb445-036a-4850-833c-0520cbdea67a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:31.966204 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-686cb445-036a-4850-833c-0520cbdea67a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:31.966757 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-686cb445-036a-4850-833c-0520cbdea67a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:32.112495 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-686cb445-036a-4850-833c-0520cbdea67a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:32.120488 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-686cb445-036a-4850-833c-0520cbdea67a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.170649 Jul 12 13:18:32.121039 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 240/480] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:31 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:32.787398 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:32.788719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:32.796658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:32.797112 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:32.797949 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:32.798286 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:32.838393 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1785527945", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "networks": [{"uuid": "47377c2f-5a61-4c27-a53d-dcba211ccf1b"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:32.893150 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] validate_networks() for [('47377c2f-5a61-4c27-a53d-dcba211ccf1b', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:18:32.948071 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:32.958382 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:32.960048 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:32.961577 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2b0519b5-7905-46ba-93f4-ba66f052e5ad tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1807 microversion: 2.20 time: 0.178255 Jul 12 13:18:32.971511 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 241/481] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:32 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:33.137799 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bf11e992-be15-4fa2-8a7b-dccca03b85ce tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:33.138431 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bf11e992-be15-4fa2-8a7b-dccca03b85ce tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:33.144722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf11e992-be15-4fa2-8a7b-dccca03b85ce tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:33.145162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf11e992-be15-4fa2-8a7b-dccca03b85ce tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:33.146027 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf11e992-be15-4fa2-8a7b-dccca03b85ce tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:33.146619 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bf11e992-be15-4fa2-8a7b-dccca03b85ce tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:33.254874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:18:33.255384 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:18:33.255775 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:18:33.256182 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:18:33.256626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:18:33.266454 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:33.267305 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:33.268129 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:33.268556 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:33.286882 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Getting quotas for project f8754507111948849d7294602bff56b6. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:18:33.290934 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Getting quotas for user 37f5a6fae8c9412da7dc2f2c9c5d2069 and project f8754507111948849d7294602bff56b6. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:18:33.303885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:18:33.306163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:18:33.308389 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-bf11e992-be15-4fa2-8a7b-dccca03b85ce tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:33.316671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-bf11e992-be15-4fa2-8a7b-dccca03b85ce tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.182681 Jul 12 13:18:33.317161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 242/482] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:33 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:33.351761 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4a04a0f3-49be-4d17-b9ba-a27ab793ec1c tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517198 Jul 12 13:18:33.353065 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 241/483] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:18:33.363907 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f0371baf-5556-4fb1-8827-cc8e8a275c4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:33.364744 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f0371baf-5556-4fb1-8827-cc8e8a275c4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:33.444960 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f0371baf-5556-4fb1-8827-cc8e8a275c4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:33.451696 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f0371baf-5556-4fb1-8827-cc8e8a275c4f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1219 microversion: 2.1 time: 0.092950 Jul 12 13:18:33.453282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 243/484] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:33 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:18:33.980766 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:33.981387 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:33.987921 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:33.988371 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:33.989130 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:33.989560 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:34.129174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:34.141054 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:34.142556 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:34.143754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3cfa95f3-288b-491a-b395-84af08f6687f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1794 microversion: 2.20 time: 0.167499 Jul 12 13:18:34.144289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 242/485] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:18:33 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1794 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:18:34.333055 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-83c7de8d-60ef-43ba-9685-54e33b86afb6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:34.333696 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-83c7de8d-60ef-43ba-9685-54e33b86afb6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:34.341252 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-83c7de8d-60ef-43ba-9685-54e33b86afb6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:34.341693 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-83c7de8d-60ef-43ba-9685-54e33b86afb6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:34.342450 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-83c7de8d-60ef-43ba-9685-54e33b86afb6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:34.342945 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-83c7de8d-60ef-43ba-9685-54e33b86afb6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:34.470136 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6de45818-7e37-44bf-b14d-4c620e0d5dde tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:34.470738 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6de45818-7e37-44bf-b14d-4c620e0d5dde tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:34.475427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-83c7de8d-60ef-43ba-9685-54e33b86afb6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:34.478247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6de45818-7e37-44bf-b14d-4c620e0d5dde tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:34.478687 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6de45818-7e37-44bf-b14d-4c620e0d5dde tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:34.479467 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6de45818-7e37-44bf-b14d-4c620e0d5dde tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:34.480234 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6de45818-7e37-44bf-b14d-4c620e0d5dde tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:34.484298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-83c7de8d-60ef-43ba-9685-54e33b86afb6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.154981 Jul 12 13:18:34.484837 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 244/486] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:34 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:34.547820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6de45818-7e37-44bf-b14d-4c620e0d5dde tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:34.558195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6de45818-7e37-44bf-b14d-4c620e0d5dde tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1215 microversion: 2.1 time: 0.093039 Jul 12 13:18:34.558763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 243/487] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:34 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:35.501633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-10cc41a6-fac0-42ef-879a-9d16745a5a5a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:35.502734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-10cc41a6-fac0-42ef-879a-9d16745a5a5a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:35.510159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-10cc41a6-fac0-42ef-879a-9d16745a5a5a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:35.510595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-10cc41a6-fac0-42ef-879a-9d16745a5a5a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:35.511439 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-10cc41a6-fac0-42ef-879a-9d16745a5a5a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:35.511861 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-10cc41a6-fac0-42ef-879a-9d16745a5a5a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:35.575597 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bddfc1e5-516d-4211-90d7-cb4e539f0d49 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:35.577736 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bddfc1e5-516d-4211-90d7-cb4e539f0d49 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:35.585612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bddfc1e5-516d-4211-90d7-cb4e539f0d49 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:35.585612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bddfc1e5-516d-4211-90d7-cb4e539f0d49 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:35.586352 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bddfc1e5-516d-4211-90d7-cb4e539f0d49 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:35.586788 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bddfc1e5-516d-4211-90d7-cb4e539f0d49 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:35.664171 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-10cc41a6-fac0-42ef-879a-9d16745a5a5a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:35.671816 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-10cc41a6-fac0-42ef-879a-9d16745a5a5a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.174371 Jul 12 13:18:35.672379 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 245/488] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:35 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:35.791491 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bddfc1e5-516d-4211-90d7-cb4e539f0d49 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:35.799751 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bddfc1e5-516d-4211-90d7-cb4e539f0d49 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1319 microversion: 2.1 time: 0.228378 Jul 12 13:18:35.800331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 244/489] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:35 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:18:36.297703 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-d17db978-757f-492d-8c8d-3885fda858a3 req-de359c7c-2424-4aea-9041-68bf2701acd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6368a0d1-a50c-4c99-9395-56e62255b974", "tag": "864b62fb-8360-498c-8605-70ff59eac424"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:36.306721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-d17db978-757f-492d-8c8d-3885fda858a3 req-de359c7c-2424-4aea-9041-68bf2701acd8 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:36.307488 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-d17db978-757f-492d-8c8d-3885fda858a3 req-de359c7c-2424-4aea-9041-68bf2701acd8 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:36.319081 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-d17db978-757f-492d-8c8d-3885fda858a3 req-de359c7c-2424-4aea-9041-68bf2701acd8 service nova] Creating event network-changed:864b62fb-8360-498c-8605-70ff59eac424 for instance 6368a0d1-a50c-4c99-9395-56e62255b974 on hv-cinder-79760 Jul 12 13:18:36.323918 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-d17db978-757f-492d-8c8d-3885fda858a3 req-de359c7c-2424-4aea-9041-68bf2701acd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030438 Jul 12 13:18:36.324562 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 246/490] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:36.688506 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a2c14fad-55f1-4b9f-ad9d-9c09d0b2a84c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:36.689172 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a2c14fad-55f1-4b9f-ad9d-9c09d0b2a84c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:36.695983 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2c14fad-55f1-4b9f-ad9d-9c09d0b2a84c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:36.696424 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2c14fad-55f1-4b9f-ad9d-9c09d0b2a84c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:36.697171 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2c14fad-55f1-4b9f-ad9d-9c09d0b2a84c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:36.697592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a2c14fad-55f1-4b9f-ad9d-9c09d0b2a84c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:36.817987 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-eda99d89-3536-46ec-adf1-d050c27904b8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:36.818986 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-eda99d89-3536-46ec-adf1-d050c27904b8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:36.826020 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eda99d89-3536-46ec-adf1-d050c27904b8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:36.826508 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eda99d89-3536-46ec-adf1-d050c27904b8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:36.827309 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eda99d89-3536-46ec-adf1-d050c27904b8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:36.827736 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eda99d89-3536-46ec-adf1-d050c27904b8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:36.832667 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=100 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:36.842806 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a2c14fad-55f1-4b9f-ad9d-9c09d0b2a84c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:36.852283 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a2c14fad-55f1-4b9f-ad9d-9c09d0b2a84c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.167560 Jul 12 13:18:36.852854 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 245/491] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:36 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:36.964821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-eda99d89-3536-46ec-adf1-d050c27904b8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:36.973059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-eda99d89-3536-46ec-adf1-d050c27904b8 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1319 microversion: 2.1 time: 0.159939 Jul 12 13:18:36.973632 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 247/492] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:36 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:37.870421 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fd1f1e35-69b3-43c4-8210-41be2fb0cad0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:37.871038 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fd1f1e35-69b3-43c4-8210-41be2fb0cad0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:37.878251 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fd1f1e35-69b3-43c4-8210-41be2fb0cad0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:37.879187 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fd1f1e35-69b3-43c4-8210-41be2fb0cad0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:37.879955 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fd1f1e35-69b3-43c4-8210-41be2fb0cad0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:37.880818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fd1f1e35-69b3-43c4-8210-41be2fb0cad0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:37.991507 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-04205635-6307-41c2-bb38-6e193f5f4c0d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:37.992076 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-04205635-6307-41c2-bb38-6e193f5f4c0d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:37.998664 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04205635-6307-41c2-bb38-6e193f5f4c0d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:37.999177 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04205635-6307-41c2-bb38-6e193f5f4c0d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:37.999923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04205635-6307-41c2-bb38-6e193f5f4c0d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:38.000524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04205635-6307-41c2-bb38-6e193f5f4c0d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:38.091925 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fd1f1e35-69b3-43c4-8210-41be2fb0cad0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:38.100708 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fd1f1e35-69b3-43c4-8210-41be2fb0cad0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.234017 Jul 12 13:18:38.101597 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 246/493] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:37 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:38.106474 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-37034dcf-82fa-484b-9376-d8ec6c8b0846 req-a08aa192-a31a-492f-a183-3fdc0834acee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8", "name": "network-vif-plugged", "status": "completed", "tag": "3c2279a3-7680-4337-9967-279c4c885c20"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:38.116263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-37034dcf-82fa-484b-9376-d8ec6c8b0846 req-a08aa192-a31a-492f-a183-3fdc0834acee service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:38.116948 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-37034dcf-82fa-484b-9376-d8ec6c8b0846 req-a08aa192-a31a-492f-a183-3fdc0834acee service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:38.132113 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-37034dcf-82fa-484b-9376-d8ec6c8b0846 req-a08aa192-a31a-492f-a183-3fdc0834acee service nova] Creating event network-vif-plugged:3c2279a3-7680-4337-9967-279c4c885c20 for instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 on hv-cinder-79760 Jul 12 13:18:38.137933 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-37034dcf-82fa-484b-9376-d8ec6c8b0846 req-a08aa192-a31a-492f-a183-3fdc0834acee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034979 Jul 12 13:18:38.138539 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 247/494] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:38.159440 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-04205635-6307-41c2-bb38-6e193f5f4c0d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:38.167370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-04205635-6307-41c2-bb38-6e193f5f4c0d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1319 microversion: 2.1 time: 0.179999 Jul 12 13:18:38.167956 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 248/495] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:37 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:18:39.120579 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d8303bde-9b3c-4cf3-86d0-d949fa88ada8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:39.121361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d8303bde-9b3c-4cf3-86d0-d949fa88ada8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:39.129604 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d8303bde-9b3c-4cf3-86d0-d949fa88ada8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:39.130052 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d8303bde-9b3c-4cf3-86d0-d949fa88ada8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:39.130820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d8303bde-9b3c-4cf3-86d0-d949fa88ada8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:39.131286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d8303bde-9b3c-4cf3-86d0-d949fa88ada8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:39.184841 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-623cb07b-f826-4623-a8db-cf58c0c49390 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:39.185530 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-623cb07b-f826-4623-a8db-cf58c0c49390 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:39.192291 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-623cb07b-f826-4623-a8db-cf58c0c49390 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:39.192734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-623cb07b-f826-4623-a8db-cf58c0c49390 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:39.193489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-623cb07b-f826-4623-a8db-cf58c0c49390 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:39.193917 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-623cb07b-f826-4623-a8db-cf58c0c49390 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:39.271516 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d8303bde-9b3c-4cf3-86d0-d949fa88ada8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:39.279973 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d8303bde-9b3c-4cf3-86d0-d949fa88ada8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1265 microversion: 2.1 time: 0.164528 Jul 12 13:18:39.280972 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 248/496] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:39 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:39.326850 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-623cb07b-f826-4623-a8db-cf58c0c49390 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:39.334528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-623cb07b-f826-4623-a8db-cf58c0c49390 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1319 microversion: 2.1 time: 0.153620 Jul 12 13:18:39.335127 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 249/497] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:39 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:40.300449 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-adbe531d-a50a-40bb-9eb1-25e556e9ece7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:40.301358 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-adbe531d-a50a-40bb-9eb1-25e556e9ece7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:40.311586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-adbe531d-a50a-40bb-9eb1-25e556e9ece7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:40.312265 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-adbe531d-a50a-40bb-9eb1-25e556e9ece7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:40.313438 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-adbe531d-a50a-40bb-9eb1-25e556e9ece7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:40.314045 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-adbe531d-a50a-40bb-9eb1-25e556e9ece7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:40.351844 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c7dee670-71a1-4324-b7f7-eacbc47c34d1 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:40.352432 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c7dee670-71a1-4324-b7f7-eacbc47c34d1 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:40.358867 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c7dee670-71a1-4324-b7f7-eacbc47c34d1 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:40.359344 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c7dee670-71a1-4324-b7f7-eacbc47c34d1 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:40.360098 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c7dee670-71a1-4324-b7f7-eacbc47c34d1 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:40.360552 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c7dee670-71a1-4324-b7f7-eacbc47c34d1 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:40.449587 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-adbe531d-a50a-40bb-9eb1-25e556e9ece7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:40.457390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-adbe531d-a50a-40bb-9eb1-25e556e9ece7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1453 microversion: 2.1 time: 0.162826 Jul 12 13:18:40.457969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 249/498] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:40 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:40.473161 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-718b8031-bd19-4cc9-bb7f-af084164008e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:40.473861 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-718b8031-bd19-4cc9-bb7f-af084164008e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:40.479753 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-718b8031-bd19-4cc9-bb7f-af084164008e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:40.480196 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-718b8031-bd19-4cc9-bb7f-af084164008e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:40.480950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-718b8031-bd19-4cc9-bb7f-af084164008e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:40.481374 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-718b8031-bd19-4cc9-bb7f-af084164008e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:40.494260 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c7dee670-71a1-4324-b7f7-eacbc47c34d1 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:40.502226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c7dee670-71a1-4324-b7f7-eacbc47c34d1 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1319 microversion: 2.1 time: 0.154239 Jul 12 13:18:40.502818 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 250/499] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:40 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:40.620325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-718b8031-bd19-4cc9-bb7f-af084164008e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:40.628522 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-718b8031-bd19-4cc9-bb7f-af084164008e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1453 microversion: 2.1 time: 0.159012 Jul 12 13:18:40.629097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 250/500] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:40 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:41.520371 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f27fd204-b341-48eb-8300-e0b6f5712256 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:41.520986 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f27fd204-b341-48eb-8300-e0b6f5712256 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:41.527934 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f27fd204-b341-48eb-8300-e0b6f5712256 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:41.528375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f27fd204-b341-48eb-8300-e0b6f5712256 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:41.529106 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f27fd204-b341-48eb-8300-e0b6f5712256 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:41.529548 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f27fd204-b341-48eb-8300-e0b6f5712256 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:41.753696 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f27fd204-b341-48eb-8300-e0b6f5712256 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:41.761480 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f27fd204-b341-48eb-8300-e0b6f5712256 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1319 microversion: 2.1 time: 0.245482 Jul 12 13:18:41.762059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 251/501] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:41 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:42.017620 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-441cb7ba-f379-46c0-b1bd-4a021447c371 req-691ea195-48d2-40fa-be83-5b9e1ed9d994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6368a0d1-a50c-4c99-9395-56e62255b974", "name": "network-vif-plugged", "status": "completed", "tag": "864b62fb-8360-498c-8605-70ff59eac424"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:42.026739 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-441cb7ba-f379-46c0-b1bd-4a021447c371 req-691ea195-48d2-40fa-be83-5b9e1ed9d994 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:42.027440 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-441cb7ba-f379-46c0-b1bd-4a021447c371 req-691ea195-48d2-40fa-be83-5b9e1ed9d994 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:42.042665 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-441cb7ba-f379-46c0-b1bd-4a021447c371 req-691ea195-48d2-40fa-be83-5b9e1ed9d994 service nova] Creating event network-vif-plugged:864b62fb-8360-498c-8605-70ff59eac424 for instance 6368a0d1-a50c-4c99-9395-56e62255b974 on hv-cinder-79760 Jul 12 13:18:42.048597 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-441cb7ba-f379-46c0-b1bd-4a021447c371 req-691ea195-48d2-40fa-be83-5b9e1ed9d994 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034787 Jul 12 13:18:42.049639 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 251/502] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:42.442359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-046ecb2a-c7c3-4eed-b692-3b0f8d667044 req-b3cab6cd-fc4c-43d8-8d54-e0627a4345ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8", "tag": "3c2279a3-7680-4337-9967-279c4c885c20"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:42.450770 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-046ecb2a-c7c3-4eed-b692-3b0f8d667044 req-b3cab6cd-fc4c-43d8-8d54-e0627a4345ce service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:42.451363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-046ecb2a-c7c3-4eed-b692-3b0f8d667044 req-b3cab6cd-fc4c-43d8-8d54-e0627a4345ce service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:42.462463 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-046ecb2a-c7c3-4eed-b692-3b0f8d667044 req-b3cab6cd-fc4c-43d8-8d54-e0627a4345ce service nova] Creating event network-changed:3c2279a3-7680-4337-9967-279c4c885c20 for instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 on hv-cinder-79760 Jul 12 13:18:42.467527 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-046ecb2a-c7c3-4eed-b692-3b0f8d667044 req-b3cab6cd-fc4c-43d8-8d54-e0627a4345ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029191 Jul 12 13:18:42.468121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 252/503] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:18:42.779365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1c067d17-9796-4599-b1ef-2149e2286609 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:42.780455 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1c067d17-9796-4599-b1ef-2149e2286609 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:42.787065 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1c067d17-9796-4599-b1ef-2149e2286609 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:42.787580 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1c067d17-9796-4599-b1ef-2149e2286609 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:42.788405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1c067d17-9796-4599-b1ef-2149e2286609 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:42.788899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1c067d17-9796-4599-b1ef-2149e2286609 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:42.928761 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1c067d17-9796-4599-b1ef-2149e2286609 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:42.936451 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1c067d17-9796-4599-b1ef-2149e2286609 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1319 microversion: 2.1 time: 0.161674 Jul 12 13:18:42.937238 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 252/504] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:42 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:43.951392 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:43.956029 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0cde477c-137d-4cd4-a413-2e9b0eb05f63 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:43.956753 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0cde477c-137d-4cd4-a413-2e9b0eb05f63 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:43.963735 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0cde477c-137d-4cd4-a413-2e9b0eb05f63 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:43.964178 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0cde477c-137d-4cd4-a413-2e9b0eb05f63 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:43.964928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0cde477c-137d-4cd4-a413-2e9b0eb05f63 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:43.965381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0cde477c-137d-4cd4-a413-2e9b0eb05f63 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:44.099286 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0cde477c-137d-4cd4-a413-2e9b0eb05f63 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:44.106813 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0cde477c-137d-4cd4-a413-2e9b0eb05f63 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1507 microversion: 2.1 time: 0.157102 Jul 12 13:18:44.107407 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 253/505] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:43 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:44.123206 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8a0967c5-cfce-47b9-adc9-e90b4131fe08 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69714730-85fb-4964-b639-368cb1221d0b", "device": "/dev/sdb"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:44.124295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8a0967c5-cfce-47b9-adc9-e90b4131fe08 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:44.126707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:44.127381 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=6 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:44.133218 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a0967c5-cfce-47b9-adc9-e90b4131fe08 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:44.133653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a0967c5-cfce-47b9-adc9-e90b4131fe08 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:44.134418 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a0967c5-cfce-47b9-adc9-e90b4131fe08 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:44.134817 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8a0967c5-cfce-47b9-adc9-e90b4131fe08 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:44.688280 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8a0967c5-cfce-47b9-adc9-e90b4131fe08 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "POST /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568857 Jul 12 13:18:44.693568 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 253/506] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:18:44 2022] POST /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:46.527776 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-327dce73-bee0-4c94-81db-923f65df4a35 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:46.528654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-327dce73-bee0-4c94-81db-923f65df4a35 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:46.537339 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-327dce73-bee0-4c94-81db-923f65df4a35 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:46.537768 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-327dce73-bee0-4c94-81db-923f65df4a35 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:46.538509 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-327dce73-bee0-4c94-81db-923f65df4a35 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:46.538934 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-327dce73-bee0-4c94-81db-923f65df4a35 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:46.562271 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-327dce73-bee0-4c94-81db-923f65df4a35 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a/ips" status: 200 len: 150 microversion: 2.1 time: 0.041198 Jul 12 13:18:46.562835 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 254/507] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:18:46 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:46.578345 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "349c2e3e-954e-40fc-808f-ce9f48c811a8"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:46.579871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:46.589589 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:46.590229 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:46.591339 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:46.591935 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:46.674004 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Invalid volume: volume 349c2e3e-954e-40fc-808f-ce9f48c811a8 is already attached to instances: 55eb648a-8acd-4221-9b30-5fcabf1d4266 Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: POST /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a/os-volume_attachments HTTP/1.1 Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 74 Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:18:46.675759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {"volumeAttachment": {"volumeId": "349c2e3e-954e-40fc-808f-ce9f48c811a8"}} Jul 12 13:18:46.677286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Invalid volume: volume 349c2e3e-954e-40fc-808f-ce9f48c811a8 is already attached to instances: 55eb648a-8acd-4221-9b30-5fcabf1d4266 Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'server_id': '8d99dc0b-1835-4e7b-816b-2315dbe1a12a', 'body': {'volumeAttachment': {'volumeId': '349c2e3e-954e-40fc-808f-ce9f48c811a8'}}} Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 349c2e3e-954e-40fc-808f-ce9f48c811a8 is already attached to instances: 55eb648a-8acd-4221-9b30-5fcabf1d4266 Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:18:46.678195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 349c2e3e-954e-40fc-808f-ce9f48c811a8 is already attached to instances: 55eb648a-8acd-4221-9b30-5fcabf1d4266 Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:18:46.679612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:18:46.681081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:18:46.681081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:18:46.681081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:18:46.681081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 349c2e3e-954e-40fc-808f-ce9f48c811a8 is already attached to instances: 55eb648a-8acd-4221-9b30-5fcabf1d4266 Jul 12 13:18:46.681081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:18:46.681081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 400 to user: Invalid volume: volume 349c2e3e-954e-40fc-808f-ce9f48c811a8 is already attached to instances: 55eb648a-8acd-4221-9b30-5fcabf1d4266 {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:18:46.681081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-10fdd5c1-10ce-4d78-adb1-071e6ad626c6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106660 Jul 12 13:18:46.681081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 254/508] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:18:46 2022] POST /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:18:46.689652 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bb9ec5f8-0231-4d05-aeed-92461d4ae03b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:46.690681 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bb9ec5f8-0231-4d05-aeed-92461d4ae03b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:46.700253 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bb9ec5f8-0231-4d05-aeed-92461d4ae03b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:46.700959 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bb9ec5f8-0231-4d05-aeed-92461d4ae03b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:46.702161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bb9ec5f8-0231-4d05-aeed-92461d4ae03b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:46.702835 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bb9ec5f8-0231-4d05-aeed-92461d4ae03b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:46.733960 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bb9ec5f8-0231-4d05-aeed-92461d4ae03b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:18:46.814435 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-bb9ec5f8-0231-4d05-aeed-92461d4ae03b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 204 len: 0 microversion: 2.1 time: 0.131143 Jul 12 13:18:46.814925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 255/509] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:18:46 2022] DELETE /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:18:46.825039 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ecab941f-f997-4807-bc8d-d59d6fd45846 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:46.825148 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ecab941f-f997-4807-bc8d-d59d6fd45846 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:46.832708 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ecab941f-f997-4807-bc8d-d59d6fd45846 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:46.833144 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ecab941f-f997-4807-bc8d-d59d6fd45846 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:46.833915 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ecab941f-f997-4807-bc8d-d59d6fd45846 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:46.834349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ecab941f-f997-4807-bc8d-d59d6fd45846 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:46.962604 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ecab941f-f997-4807-bc8d-d59d6fd45846 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:46.970911 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ecab941f-f997-4807-bc8d-d59d6fd45846 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1681 microversion: 2.1 time: 0.150682 Jul 12 13:18:46.971504 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 255/510] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:46 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:47.991971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6dd51dab-7b86-4b9d-8fb2-1bef827f3a84 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:47.992722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6dd51dab-7b86-4b9d-8fb2-1bef827f3a84 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:47.995989 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:48.002449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6dd51dab-7b86-4b9d-8fb2-1bef827f3a84 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:48.002890 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6dd51dab-7b86-4b9d-8fb2-1bef827f3a84 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:48.003672 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6dd51dab-7b86-4b9d-8fb2-1bef827f3a84 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:48.004095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6dd51dab-7b86-4b9d-8fb2-1bef827f3a84 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:48.139222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6dd51dab-7b86-4b9d-8fb2-1bef827f3a84 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:48.148014 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6dd51dab-7b86-4b9d-8fb2-1bef827f3a84 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1681 microversion: 2.1 time: 0.162824 Jul 12 13:18:48.148585 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 256/511] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:47 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:48.873008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b0e899ce-3d65-43e7-93b9-4f555872d3d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fe648e8-3da1-4991-b459-8cb71162e16a"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:48.874317 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b0e899ce-3d65-43e7-93b9-4f555872d3d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:48.881516 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0e899ce-3d65-43e7-93b9-4f555872d3d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:48.881956 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0e899ce-3d65-43e7-93b9-4f555872d3d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:48.882715 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0e899ce-3d65-43e7-93b9-4f555872d3d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:48.883186 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b0e899ce-3d65-43e7-93b9-4f555872d3d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:48.886907 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:49.165003 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-99285005-3acf-44e7-9e59-1fa3205c0e11 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:49.165608 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-99285005-3acf-44e7-9e59-1fa3205c0e11 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:49.174446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-99285005-3acf-44e7-9e59-1fa3205c0e11 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:49.174908 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-99285005-3acf-44e7-9e59-1fa3205c0e11 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:49.175692 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-99285005-3acf-44e7-9e59-1fa3205c0e11 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:49.176274 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-99285005-3acf-44e7-9e59-1fa3205c0e11 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:49.273137 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b0e899ce-3d65-43e7-93b9-4f555872d3d1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404707 Jul 12 13:18:49.273872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 256/512] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:18:48 2022] POST /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:49.329991 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-99285005-3acf-44e7-9e59-1fa3205c0e11 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:49.337678 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-99285005-3acf-44e7-9e59-1fa3205c0e11 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1681 microversion: 2.1 time: 0.176534 Jul 12 13:18:49.338246 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 257/513] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:49 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:18:50.226799 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-cef8bdf5-d345-4c7d-9c1b-7b0a503ce618 req-c0a54b30-16da-40de-82c6-bc1e07c19b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d99dc0b-1835-4e7b-816b-2315dbe1a12a", "name": "network-vif-deleted", "tag": "b093819a-294c-4c02-8673-aaec05b9bd6a"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:18:50.234295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-cef8bdf5-d345-4c7d-9c1b-7b0a503ce618 req-c0a54b30-16da-40de-82c6-bc1e07c19b5c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:50.234722 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-cef8bdf5-d345-4c7d-9c1b-7b0a503ce618 req-c0a54b30-16da-40de-82c6-bc1e07c19b5c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:50.247130 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-cef8bdf5-d345-4c7d-9c1b-7b0a503ce618 req-c0a54b30-16da-40de-82c6-bc1e07c19b5c service nova] Creating event network-vif-deleted:b093819a-294c-4c02-8673-aaec05b9bd6a for instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a on hv-cinder-79760 Jul 12 13:18:50.252407 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-cef8bdf5-d345-4c7d-9c1b-7b0a503ce618 req-c0a54b30-16da-40de-82c6-bc1e07c19b5c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031175 Jul 12 13:18:50.253232 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 257/514] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:50.356010 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ad66da35-878f-49f9-8a8a-6f12b9dd27f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:50.356703 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ad66da35-878f-49f9-8a8a-6f12b9dd27f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:50.364519 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad66da35-878f-49f9-8a8a-6f12b9dd27f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:50.365047 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad66da35-878f-49f9-8a8a-6f12b9dd27f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:50.365886 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad66da35-878f-49f9-8a8a-6f12b9dd27f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:50.366496 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad66da35-878f-49f9-8a8a-6f12b9dd27f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:50.453026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ad66da35-878f-49f9-8a8a-6f12b9dd27f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:50.461466 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ad66da35-878f-49f9-8a8a-6f12b9dd27f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1326 microversion: 2.1 time: 0.109388 Jul 12 13:18:50.462040 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 258/515] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:50 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:51.480518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:51.481202 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:51.488114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:51.488549 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:51.489307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:51.489729 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:51.524542 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:51.524950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:51.525398 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lazy-loading 'fault' on Instance uuid 8d99dc0b-1835-4e7b-816b-2315dbe1a12a {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:18:51.574082 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:18:51.582160 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-67ad14dc-6300-4b31-a10c-e1f4f83d5e4d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 200 len: 1331 microversion: 2.1 time: 0.106245 Jul 12 13:18:51.582754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 258/516] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:51 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:18:52.600718 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:52.601298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:52.608215 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:52.608660 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:52.609398 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:52.609841 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:52.623785 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a HTTP/1.1 Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:18:52.625400 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:18:52.627159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '8d99dc0b-1835-4e7b-816b-2315dbe1a12a'} Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:18:52.627920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:18:52.629310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:18:52.630614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:18:52.630614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2ada1e67-0c37-42e2-bcb9-a5126cdc33ab tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 404 len: 111 microversion: 2.1 time: 0.030163 Jul 12 13:18:52.630614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 259/517] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:18:52 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:18:52.638854 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-856ba821-5db3-4189-bbf4-e015098daf2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '.version_select at 0x7fd48d124940>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:52.661244 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-856ba821-5db3-4189-bbf4-e015098daf2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276987071" status: 202 len: 0 microversion: 2.1 time: 0.028574 Jul 12 13:18:52.661811 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 259/518] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 12 13:18:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276987071 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:18:53.338529 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e9641399-c558-49ba-83b1-2794ef28815d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:53.339046 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e9641399-c558-49ba-83b1-2794ef28815d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:53.345261 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e9641399-c558-49ba-83b1-2794ef28815d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:53.345759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e9641399-c558-49ba-83b1-2794ef28815d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:53.346523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e9641399-c558-49ba-83b1-2794ef28815d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:53.346969 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e9641399-c558-49ba-83b1-2794ef28815d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:53.439207 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-e9641399-c558-49ba-83b1-2794ef28815d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lazy-loading 'services' on Instance uuid 55eb648a-8acd-4221-9b30-5fcabf1d4266 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:18:53.521992 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e9641399-c558-49ba-83b1-2794ef28815d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments/349c2e3e-954e-40fc-808f-ce9f48c811a8" status: 202 len: 0 microversion: 2.1 time: 0.187183 Jul 12 13:18:53.522565 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 260/519] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:18:53 2022] DELETE /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments/349c2e3e-954e-40fc-808f-ce9f48c811a8 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:18:53.532961 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f65b9b6d-6712-4738-85b0-a8293158518a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:53.533876 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f65b9b6d-6712-4738-85b0-a8293158518a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:53.541193 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f65b9b6d-6712-4738-85b0-a8293158518a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:53.541979 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f65b9b6d-6712-4738-85b0-a8293158518a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:53.542819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f65b9b6d-6712-4738-85b0-a8293158518a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:53.543344 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f65b9b6d-6712-4738-85b0-a8293158518a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:53.574654 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f65b9b6d-6712-4738-85b0-a8293158518a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047491 Jul 12 13:18:53.575266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 260/520] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:18:53 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:54.592384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6e1408c3-15a5-4e2f-957f-38f7569d2adf tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:54.594086 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6e1408c3-15a5-4e2f-957f-38f7569d2adf tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:54.601604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6e1408c3-15a5-4e2f-957f-38f7569d2adf tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:54.601764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6e1408c3-15a5-4e2f-957f-38f7569d2adf tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:54.602690 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6e1408c3-15a5-4e2f-957f-38f7569d2adf tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:54.603161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6e1408c3-15a5-4e2f-957f-38f7569d2adf tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:54.634160 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6e1408c3-15a5-4e2f-957f-38f7569d2adf tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049907 Jul 12 13:18:54.634726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 261/521] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:18:54 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:55.650551 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-527ad0fc-59b8-47b7-96db-67fff20828b6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:55.652036 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-527ad0fc-59b8-47b7-96db-67fff20828b6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:55.663252 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-527ad0fc-59b8-47b7-96db-67fff20828b6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:55.663980 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-527ad0fc-59b8-47b7-96db-67fff20828b6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:55.665230 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-527ad0fc-59b8-47b7-96db-67fff20828b6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:55.665931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-527ad0fc-59b8-47b7-96db-67fff20828b6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:55.699366 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-527ad0fc-59b8-47b7-96db-67fff20828b6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055264 Jul 12 13:18:55.700159 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 261/522] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:18:55 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:56.715313 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b5c8c114-aa55-4cc7-90b3-4a03c81fe569 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:56.716805 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b5c8c114-aa55-4cc7-90b3-4a03c81fe569 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:56.727935 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b5c8c114-aa55-4cc7-90b3-4a03c81fe569 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:56.728684 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b5c8c114-aa55-4cc7-90b3-4a03c81fe569 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:56.729914 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b5c8c114-aa55-4cc7-90b3-4a03c81fe569 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:56.730615 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b5c8c114-aa55-4cc7-90b3-4a03c81fe569 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:56.762531 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b5c8c114-aa55-4cc7-90b3-4a03c81fe569 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053787 Jul 12 13:18:56.763123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 262/523] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:18:56 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:57.774142 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f7c97303-49a7-427b-9c9d-adf45f2f622e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:57.775030 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f7c97303-49a7-427b-9c9d-adf45f2f622e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:57.777442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:57.782835 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7c97303-49a7-427b-9c9d-adf45f2f622e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:57.783275 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7c97303-49a7-427b-9c9d-adf45f2f622e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:57.784093 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7c97303-49a7-427b-9c9d-adf45f2f622e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:57.784458 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f7c97303-49a7-427b-9c9d-adf45f2f622e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:57.819119 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f7c97303-49a7-427b-9c9d-adf45f2f622e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048976 Jul 12 13:18:57.819668 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 262/524] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:18:57 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:58.833861 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a674abc7-7092-44f4-ba5a-83a73b6d8cee tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:58.835275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a674abc7-7092-44f4-ba5a-83a73b6d8cee tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:58.844484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a674abc7-7092-44f4-ba5a-83a73b6d8cee tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:58.845130 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a674abc7-7092-44f4-ba5a-83a73b6d8cee tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:58.846285 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a674abc7-7092-44f4-ba5a-83a73b6d8cee tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:58.846924 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a674abc7-7092-44f4-ba5a-83a73b6d8cee tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:58.852396 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:18:58.881789 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a674abc7-7092-44f4-ba5a-83a73b6d8cee tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053849 Jul 12 13:18:58.882372 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 263/525] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:18:58 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:18:59.897870 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1e0809a5-57d5-4eda-9510-1bc00c69453d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:18:59.899405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1e0809a5-57d5-4eda-9510-1bc00c69453d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:18:59.909341 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e0809a5-57d5-4eda-9510-1bc00c69453d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:59.909787 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e0809a5-57d5-4eda-9510-1bc00c69453d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:59.910538 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e0809a5-57d5-4eda-9510-1bc00c69453d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:18:59.910983 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e0809a5-57d5-4eda-9510-1bc00c69453d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:18:59.940850 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1e0809a5-57d5-4eda-9510-1bc00c69453d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049870 Jul 12 13:18:59.944894 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 263/526] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:18:59 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:00.955442 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-730ace03-31a7-419d-91d6-cda8ab18dbc7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:00.956484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-730ace03-31a7-419d-91d6-cda8ab18dbc7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:00.964250 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-730ace03-31a7-419d-91d6-cda8ab18dbc7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:00.964739 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-730ace03-31a7-419d-91d6-cda8ab18dbc7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:00.965575 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-730ace03-31a7-419d-91d6-cda8ab18dbc7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:00.966067 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-730ace03-31a7-419d-91d6-cda8ab18dbc7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:00.999605 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-730ace03-31a7-419d-91d6-cda8ab18dbc7 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050157 Jul 12 13:19:01.000147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 264/527] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:19:00 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:02.013162 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-11e65d38-cd78-4f7e-be53-23bf42360a97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:02.014112 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-11e65d38-cd78-4f7e-be53-23bf42360a97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:02.021228 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-11e65d38-cd78-4f7e-be53-23bf42360a97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:02.021672 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-11e65d38-cd78-4f7e-be53-23bf42360a97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:02.022417 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-11e65d38-cd78-4f7e-be53-23bf42360a97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:02.022841 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-11e65d38-cd78-4f7e-be53-23bf42360a97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:02.053661 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-11e65d38-cd78-4f7e-be53-23bf42360a97 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Jul 12 13:19:02.054430 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 264/528] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:19:02 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:02.142364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cf6c9a12-50c7-4d55-b8bc-af6813ea6e5b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:02.143346 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cf6c9a12-50c7-4d55-b8bc-af6813ea6e5b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:02.149876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cf6c9a12-50c7-4d55-b8bc-af6813ea6e5b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:02.150350 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cf6c9a12-50c7-4d55-b8bc-af6813ea6e5b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:02.151122 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cf6c9a12-50c7-4d55-b8bc-af6813ea6e5b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:02.151551 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cf6c9a12-50c7-4d55-b8bc-af6813ea6e5b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:02.174707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-cf6c9a12-50c7-4d55-b8bc-af6813ea6e5b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lazy-loading 'flavor' on Instance uuid bd7df43b-4b7b-46af-ad37-d0267407bff2 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:19:02.300094 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cf6c9a12-50c7-4d55-b8bc-af6813ea6e5b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/action" status: 200 len: 32 microversion: 2.1 time: 0.161919 Jul 12 13:19:02.300730 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 265/529] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:19:02 2022] POST /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:19:02.310203 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6bf89cd6-922a-40a5-b195-7f560142d01e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:02.310918 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6bf89cd6-922a-40a5-b195-7f560142d01e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:02.317739 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6bf89cd6-922a-40a5-b195-7f560142d01e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:02.318176 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6bf89cd6-922a-40a5-b195-7f560142d01e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:02.318953 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6bf89cd6-922a-40a5-b195-7f560142d01e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:02.319410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6bf89cd6-922a-40a5-b195-7f560142d01e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:02.460304 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6bf89cd6-922a-40a5-b195-7f560142d01e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:02.470727 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6bf89cd6-922a-40a5-b195-7f560142d01e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.164571 Jul 12 13:19:02.471588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 265/530] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:02 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:03.065950 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-61973b7d-f5c1-4d31-b038-98a937ba76fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:03.066931 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-61973b7d-f5c1-4d31-b038-98a937ba76fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:03.073254 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61973b7d-f5c1-4d31-b038-98a937ba76fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:03.073660 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61973b7d-f5c1-4d31-b038-98a937ba76fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:03.074929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61973b7d-f5c1-4d31-b038-98a937ba76fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:03.075364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61973b7d-f5c1-4d31-b038-98a937ba76fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:03.105662 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-61973b7d-f5c1-4d31-b038-98a937ba76fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044322 Jul 12 13:19:03.106211 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 266/531] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:19:03 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:19:03.165273 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-687c4c07-73ad-4d0c-abcc-504f12f3b471 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:03.165823 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-687c4c07-73ad-4d0c-abcc-504f12f3b471 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:03.173555 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-687c4c07-73ad-4d0c-abcc-504f12f3b471 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:03.174092 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-687c4c07-73ad-4d0c-abcc-504f12f3b471 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:03.174832 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-687c4c07-73ad-4d0c-abcc-504f12f3b471 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:03.175304 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-687c4c07-73ad-4d0c-abcc-504f12f3b471 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:03.201839 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-687c4c07-73ad-4d0c-abcc-504f12f3b471 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:19:03.286036 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-687c4c07-73ad-4d0c-abcc-504f12f3b471 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 204 len: 0 microversion: 2.1 time: 0.124344 Jul 12 13:19:03.286629 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 266/532] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:19:03 2022] DELETE /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:19:03.295863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e893aa74-a81a-4b30-8a73-8fe648c1e684 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:03.296436 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e893aa74-a81a-4b30-8a73-8fe648c1e684 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:03.304223 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e893aa74-a81a-4b30-8a73-8fe648c1e684 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:03.304890 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e893aa74-a81a-4b30-8a73-8fe648c1e684 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:03.305646 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e893aa74-a81a-4b30-8a73-8fe648c1e684 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:03.306077 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e893aa74-a81a-4b30-8a73-8fe648c1e684 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:03.434327 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e893aa74-a81a-4b30-8a73-8fe648c1e684 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:03.442427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e893aa74-a81a-4b30-8a73-8fe648c1e684 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1681 microversion: 2.1 time: 0.151447 Jul 12 13:19:03.442989 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 267/533] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:03 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:19:03.489669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c19eb38d-dc92-414e-83eb-4928da60daf5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:03.490275 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c19eb38d-dc92-414e-83eb-4928da60daf5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:03.496903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c19eb38d-dc92-414e-83eb-4928da60daf5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:03.497345 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c19eb38d-dc92-414e-83eb-4928da60daf5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:03.498096 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c19eb38d-dc92-414e-83eb-4928da60daf5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:03.498548 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c19eb38d-dc92-414e-83eb-4928da60daf5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:03.638203 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c19eb38d-dc92-414e-83eb-4928da60daf5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:03.649137 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c19eb38d-dc92-414e-83eb-4928da60daf5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.164370 Jul 12 13:19:03.649715 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 267/534] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:03 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:04.459836 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3e9a675f-eead-4d06-ba83-776d5fb3cb6e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:04.460433 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3e9a675f-eead-4d06-ba83-776d5fb3cb6e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:04.467467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e9a675f-eead-4d06-ba83-776d5fb3cb6e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:04.467909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e9a675f-eead-4d06-ba83-776d5fb3cb6e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:04.468664 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e9a675f-eead-4d06-ba83-776d5fb3cb6e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:04.469103 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3e9a675f-eead-4d06-ba83-776d5fb3cb6e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:04.610097 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3e9a675f-eead-4d06-ba83-776d5fb3cb6e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:04.617990 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3e9a675f-eead-4d06-ba83-776d5fb3cb6e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1681 microversion: 2.1 time: 0.162111 Jul 12 13:19:04.618576 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 268/535] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:04 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:19:04.667950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-750243d7-8a04-404e-9a2c-d7e4db991833 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:04.668575 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-750243d7-8a04-404e-9a2c-d7e4db991833 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:04.675400 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-750243d7-8a04-404e-9a2c-d7e4db991833 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:04.675835 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-750243d7-8a04-404e-9a2c-d7e4db991833 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:04.676586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-750243d7-8a04-404e-9a2c-d7e4db991833 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:04.677006 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-750243d7-8a04-404e-9a2c-d7e4db991833 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:04.814774 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-750243d7-8a04-404e-9a2c-d7e4db991833 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:04.823477 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-750243d7-8a04-404e-9a2c-d7e4db991833 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.159683 Jul 12 13:19:04.824060 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 268/536] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:04 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:05.204934 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0aff6665-f6bc-417a-886f-c78e4877df5f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:05.205431 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0aff6665-f6bc-417a-886f-c78e4877df5f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:05.211903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0aff6665-f6bc-417a-886f-c78e4877df5f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:05.212349 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0aff6665-f6bc-417a-886f-c78e4877df5f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:05.213115 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0aff6665-f6bc-417a-886f-c78e4877df5f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:05.213554 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0aff6665-f6bc-417a-886f-c78e4877df5f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:05.297469 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-0aff6665-f6bc-417a-886f-c78e4877df5f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lazy-loading 'services' on Instance uuid 6368a0d1-a50c-4c99-9395-56e62255b974 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:19:05.374928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0aff6665-f6bc-417a-886f-c78e4877df5f tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974/os-volume_attachments/69714730-85fb-4964-b639-368cb1221d0b" status: 202 len: 0 microversion: 2.1 time: 0.173719 Jul 12 13:19:05.375589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 269/537] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:19:05 2022] DELETE /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974/os-volume_attachments/69714730-85fb-4964-b639-368cb1221d0b => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:19:05.635386 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-281a8cba-fa68-495b-9290-365c46b23fb4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:05.636000 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-281a8cba-fa68-495b-9290-365c46b23fb4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:05.642415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281a8cba-fa68-495b-9290-365c46b23fb4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:05.642864 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281a8cba-fa68-495b-9290-365c46b23fb4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:05.643664 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281a8cba-fa68-495b-9290-365c46b23fb4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:05.644087 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281a8cba-fa68-495b-9290-365c46b23fb4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:05.842308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e3c35d76-b30d-43f1-9f53-e1ea6054b58c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:05.843119 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e3c35d76-b30d-43f1-9f53-e1ea6054b58c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:05.850057 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e3c35d76-b30d-43f1-9f53-e1ea6054b58c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:05.850749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e3c35d76-b30d-43f1-9f53-e1ea6054b58c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:05.851543 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e3c35d76-b30d-43f1-9f53-e1ea6054b58c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:05.851970 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e3c35d76-b30d-43f1-9f53-e1ea6054b58c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:05.901357 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-281a8cba-fa68-495b-9290-365c46b23fb4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:05.909136 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-281a8cba-fa68-495b-9290-365c46b23fb4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1681 microversion: 2.1 time: 0.277738 Jul 12 13:19:05.910061 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 269/538] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:05 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1681 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:06.251537 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e3c35d76-b30d-43f1-9f53-e1ea6054b58c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:06.261597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e3c35d76-b30d-43f1-9f53-e1ea6054b58c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.423995 Jul 12 13:19:06.262192 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 270/539] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:05 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:06.444273 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-324c6f6e-dc7a-43fa-a469-f6274ab4d9bb req-cb392d4a-52a0-49ff-8ca9-647ed658ef72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55eb648a-8acd-4221-9b30-5fcabf1d4266", "name": "network-vif-deleted", "tag": "60d74868-426c-4926-a466-31bbc0856014"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:06.457047 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-324c6f6e-dc7a-43fa-a469-f6274ab4d9bb req-cb392d4a-52a0-49ff-8ca9-647ed658ef72 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:06.457715 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-324c6f6e-dc7a-43fa-a469-f6274ab4d9bb req-cb392d4a-52a0-49ff-8ca9-647ed658ef72 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:06.473332 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-324c6f6e-dc7a-43fa-a469-f6274ab4d9bb req-cb392d4a-52a0-49ff-8ca9-647ed658ef72 service nova] Creating event network-vif-deleted:60d74868-426c-4926-a466-31bbc0856014 for instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 on hv-cinder-79760 Jul 12 13:19:06.479456 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-324c6f6e-dc7a-43fa-a469-f6274ab4d9bb req-cb392d4a-52a0-49ff-8ca9-647ed658ef72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043589 Jul 12 13:19:06.480800 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 270/540] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:06.927579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:06.928124 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:06.935187 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:06.935920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:06.936919 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:06.937569 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:06.971589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:06.972010 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:06.972654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lazy-loading 'fault' on Instance uuid 55eb648a-8acd-4221-9b30-5fcabf1d4266 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:19:07.018502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:07.026863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0e5b1f18-a61b-41b3-9222-67d20925dc80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 200 len: 1331 microversion: 2.1 time: 0.103333 Jul 12 13:19:07.027650 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 271/541] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:06 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:07.280604 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3e56d239-dbc7-4250-8af2-33e3c04aa979 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:07.281284 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3e56d239-dbc7-4250-8af2-33e3c04aa979 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:07.288269 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e56d239-dbc7-4250-8af2-33e3c04aa979 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:07.288707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e56d239-dbc7-4250-8af2-33e3c04aa979 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:07.289466 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e56d239-dbc7-4250-8af2-33e3c04aa979 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:07.289887 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e56d239-dbc7-4250-8af2-33e3c04aa979 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:07.425725 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3e56d239-dbc7-4250-8af2-33e3c04aa979 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:07.429369 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:07.435766 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3e56d239-dbc7-4250-8af2-33e3c04aa979 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.159817 Jul 12 13:19:07.436353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 271/542] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:07 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:07.582095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6ac1f625-f30e-461d-b90f-2dc99c201172 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:07.582590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6ac1f625-f30e-461d-b90f-2dc99c201172 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:07.589356 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6ac1f625-f30e-461d-b90f-2dc99c201172 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:07.589802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6ac1f625-f30e-461d-b90f-2dc99c201172 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:07.590572 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6ac1f625-f30e-461d-b90f-2dc99c201172 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:07.590981 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6ac1f625-f30e-461d-b90f-2dc99c201172 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:07.615667 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6ac1f625-f30e-461d-b90f-2dc99c201172 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:19:07.699095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6ac1f625-f30e-461d-b90f-2dc99c201172 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 204 len: 0 microversion: 2.1 time: 0.120619 Jul 12 13:19:07.699784 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 272/543] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:19:07 2022] DELETE /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:19:07.708931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1d682352-768d-4f2c-8c56-60368d492cba tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:07.709532 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1d682352-768d-4f2c-8c56-60368d492cba tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:07.715853 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d682352-768d-4f2c-8c56-60368d492cba tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:07.716221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d682352-768d-4f2c-8c56-60368d492cba tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:07.716962 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d682352-768d-4f2c-8c56-60368d492cba tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:07.717377 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1d682352-768d-4f2c-8c56-60368d492cba tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:07.866471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1d682352-768d-4f2c-8c56-60368d492cba tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:07.874942 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1d682352-768d-4f2c-8c56-60368d492cba tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1513 microversion: 2.1 time: 0.170304 Jul 12 13:19:07.875558 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 272/544] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:07 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:08.045534 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:08.046240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:08.053079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:08.053518 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:08.054272 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:08.054697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:08.069178 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 HTTP/1.1 Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:19:08.070800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:19:08.072319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '55eb648a-8acd-4221-9b30-5fcabf1d4266'} Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:19:08.073240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:19:08.074654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:08.076383 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:19:08.076383 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f1782b5b-8870-47c5-8dfe-3b9d3a62c3f9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 404 len: 111 microversion: 2.1 time: 0.031253 Jul 12 13:19:08.076383 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 273/545] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:08 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:19:08.084004 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a3b8b456-80c2-4b96-a7d2-ebce6cbaea2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '.version_select at 0x7fd48d142ca0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:08.108063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a3b8b456-80c2-4b96-a7d2-ebce6cbaea2d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752439818" status: 202 len: 0 microversion: 2.1 time: 0.030316 Jul 12 13:19:08.108606 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 273/546] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 12 13:19:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752439818 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:19:08.454220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c0ba612c-1df7-4325-b012-7b94f3f8220b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:08.454834 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c0ba612c-1df7-4325-b012-7b94f3f8220b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:08.461407 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0ba612c-1df7-4325-b012-7b94f3f8220b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:08.461867 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0ba612c-1df7-4325-b012-7b94f3f8220b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:08.463287 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0ba612c-1df7-4325-b012-7b94f3f8220b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:08.463722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0ba612c-1df7-4325-b012-7b94f3f8220b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:08.657155 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c0ba612c-1df7-4325-b012-7b94f3f8220b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:08.665262 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c0ba612c-1df7-4325-b012-7b94f3f8220b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.215225 Jul 12 13:19:08.665800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 274/547] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:08 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:08.821269 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a0efa086-4eb6-4d66-83db-5f21064e9e81 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: .version_select at 0x7fd48d1ca550>, body: {"keypair": {"name": "tempest-keypair-1231534623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdvqBsZ1JG3/U15/vZ0WYnXidblDTsKum7H9R5p3BImGz+5hGeI/DvrhiFWWO6pSCJzdVtlKVx7DHQw5x7PmaQqoJOLbQM+VLxWMM+AwrocN8VGVUE6Yry3HLhfyhWMfw=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:08.837909 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-a0efa086-4eb6-4d66-83db-5f21064e9e81 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:19:08.842406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-a0efa086-4eb6-4d66-83db-5f21064e9e81 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for user c8380cfce8114b609c8f0cbf9d445049 and project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:19:08.868494 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a0efa086-4eb6-4d66-83db-5f21064e9e81 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051568 Jul 12 13:19:08.869530 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 274/548] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:19:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:08.892628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d933bd6a-4179-439d-8f07-1e3a48d3c18d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:08.893231 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d933bd6a-4179-439d-8f07-1e3a48d3c18d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:08.900316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d933bd6a-4179-439d-8f07-1e3a48d3c18d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:08.900875 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d933bd6a-4179-439d-8f07-1e3a48d3c18d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:08.902430 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d933bd6a-4179-439d-8f07-1e3a48d3c18d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:08.903164 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d933bd6a-4179-439d-8f07-1e3a48d3c18d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:09.050467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d933bd6a-4179-439d-8f07-1e3a48d3c18d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:09.054661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:09.059382 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d933bd6a-4179-439d-8f07-1e3a48d3c18d tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1513 microversion: 2.1 time: 0.170898 Jul 12 13:19:09.059973 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 275/549] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:08 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:09.684255 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9a62948d-a190-45dd-a563-39ac72c4762a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:09.684886 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9a62948d-a190-45dd-a563-39ac72c4762a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:09.691545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a62948d-a190-45dd-a563-39ac72c4762a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:09.691996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a62948d-a190-45dd-a563-39ac72c4762a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:09.692778 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a62948d-a190-45dd-a563-39ac72c4762a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:09.693192 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a62948d-a190-45dd-a563-39ac72c4762a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:09.879496 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a62948d-a190-45dd-a563-39ac72c4762a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:09.887950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9a62948d-a190-45dd-a563-39ac72c4762a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.208335 Jul 12 13:19:09.888759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 275/550] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:09 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:10.077968 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-051107b9-30ae-49d1-9fb1-fd7284230a44 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:10.079592 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-051107b9-30ae-49d1-9fb1-fd7284230a44 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:10.088110 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-051107b9-30ae-49d1-9fb1-fd7284230a44 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:10.088613 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-051107b9-30ae-49d1-9fb1-fd7284230a44 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:10.089425 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-051107b9-30ae-49d1-9fb1-fd7284230a44 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:10.089898 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-051107b9-30ae-49d1-9fb1-fd7284230a44 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:10.200294 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-457165739", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5765647a-f52d-4fde-ab6b-47dcfe530ab0"}], "security_groups": [{"name": "tempest-securitygroup--617856892"}], "key_name": "tempest-keypair-1231534623", "user_data": "}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:10.234227 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-051107b9-30ae-49d1-9fb1-fd7284230a44 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f5a6fae8c9412da7dc2f2c9c5d2069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8754507111948849d7294602bff56b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:10.242384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-051107b9-30ae-49d1-9fb1-fd7284230a44 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 200 len: 1513 microversion: 2.1 time: 0.168482 Jul 12 13:19:10.242999 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 276/551] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:10 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:10.302233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-1726111e-2dcb-4a3e-9c66-d3774dcb8363 req-695ef9c5-93ef-44a1-8574-3eb74c5cd5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6368a0d1-a50c-4c99-9395-56e62255b974", "name": "network-vif-deleted", "tag": "864b62fb-8360-498c-8605-70ff59eac424"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:10.313543 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-1726111e-2dcb-4a3e-9c66-d3774dcb8363 req-695ef9c5-93ef-44a1-8574-3eb74c5cd5d3 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:10.313986 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-1726111e-2dcb-4a3e-9c66-d3774dcb8363 req-695ef9c5-93ef-44a1-8574-3eb74c5cd5d3 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:10.327076 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-1726111e-2dcb-4a3e-9c66-d3774dcb8363 req-695ef9c5-93ef-44a1-8574-3eb74c5cd5d3 service nova] Creating event network-vif-deleted:864b62fb-8360-498c-8605-70ff59eac424 for instance 6368a0d1-a50c-4c99-9395-56e62255b974 on hv-cinder-79760 Jul 12 13:19:10.333104 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-1726111e-2dcb-4a3e-9c66-d3774dcb8363 req-695ef9c5-93ef-44a1-8574-3eb74c5cd5d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034239 Jul 12 13:19:10.333918 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 277/552] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:19:10.347493 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] validate_networks() for [('5765647a-f52d-4fde-ab6b-47dcfe530ab0', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:19:10.727466 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:19:10.727882 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:19:10.728347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:19:10.728754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:19:10.729165 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:19:10.739291 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:10.739738 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:10.740554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:10.740980 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:10.759089 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:19:10.763332 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for user c8380cfce8114b609c8f0cbf9d445049 and project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:19:10.776723 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:19:10.779000 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:19:10.830219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-42f564b8-28cc-4c36-8a74-ccfc95240c02 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.634200 Jul 12 13:19:10.830871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 276/553] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:19:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 13:19:10.841620 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fdbfab96-6b0b-4887-8966-09a59819b8d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:10.842421 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fdbfab96-6b0b-4887-8966-09a59819b8d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:10.902907 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fdbfab96-6b0b-4887-8966-09a59819b8d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:10.905832 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ccbc4cbe-3a6e-4073-a956-115db071587f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:10.906760 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ccbc4cbe-3a6e-4073-a956-115db071587f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:10.909970 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fdbfab96-6b0b-4887-8966-09a59819b8d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1241 microversion: 2.1 time: 0.072643 Jul 12 13:19:10.911293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 278/554] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:10 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:10.914839 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ccbc4cbe-3a6e-4073-a956-115db071587f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:10.915304 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ccbc4cbe-3a6e-4073-a956-115db071587f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:10.916059 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ccbc4cbe-3a6e-4073-a956-115db071587f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:10.919974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ccbc4cbe-3a6e-4073-a956-115db071587f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:11.059908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ccbc4cbe-3a6e-4073-a956-115db071587f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:11.068395 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ccbc4cbe-3a6e-4073-a956-115db071587f tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.166407 Jul 12 13:19:11.069045 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 277/555] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:10 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:11.260145 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:11.260737 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] [instance: 6368a0d1-a50c-4c99-9395-56e62255b974] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:11.272329 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:11.272897 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:11.273784 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:11.274214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:11.289962 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] HTTP exception thrown: Instance 6368a0d1-a50c-4c99-9395-56e62255b974 could not be found. Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Request method failure captured: Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 HTTP/1.1 Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXRA8Ubzr1qIB0YHhwqOXkV2kpD_7LXR6L00EsB_slJW5cb8QUJjtdK93t5cLqdbKNogF_wKzO2djpAuKxBueY2FmADCsXRd4kjKG6-W4HK-j0Zfp7-l6L6BudKbtYwb-r0nBLdQtntR6so1dy2ofG9TxW1fEMZ6m4LWNapocvmF5jw Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: f8754507111948849d7294602bff56b6 Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesSnapshotTestJSON-799596431 Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:19:11.291944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8754507111948849d7294602bff56b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8754507111948849d7294602bff56b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8754507111948849d7294602bff56b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8754507111948849d7294602bff56b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesSnapshotTestJSON-799596431 Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: f8754507111948849d7294602bff56b6 Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-799596431 Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesSnapshotTestJSON-799596431-project Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 37f5a6fae8c9412da7dc2f2c9c5d2069 Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesSnapshotTestJSON-799596431-project Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 6368a0d1-a50c-4c99-9395-56e62255b974 could not be found. Jul 12 13:19:11.293599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '6368a0d1-a50c-4c99-9395-56e62255b974'} Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6368a0d1-a50c-4c99-9395-56e62255b974 could not be found. Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:19:11.294699 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6368a0d1-a50c-4c99-9395-56e62255b974 could not be found. Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6368a0d1-a50c-4c99-9395-56e62255b974 could not be found. Jul 12 13:19:11.296220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:11.297519 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] Returning 404 to user: Instance 6368a0d1-a50c-4c99-9395-56e62255b974 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:19:11.297519 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-88d7f9eb-3c35-4f84-afd8-e3b1f05172c0 tempest-VolumesSnapshotTestJSON-799596431 tempest-VolumesSnapshotTestJSON-799596431-project] 10.222.0.33 "GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974" status: 404 len: 111 microversion: 2.1 time: 0.037848 Jul 12 13:19:11.297519 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 279/556] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:11 2022] GET /compute/v2.1/servers/6368a0d1-a50c-4c99-9395-56e62255b974 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:19:11.929096 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-72e83abe-4b0f-4e3f-9d81-07fcf05df851 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:11.929731 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-72e83abe-4b0f-4e3f-9d81-07fcf05df851 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:11.936488 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72e83abe-4b0f-4e3f-9d81-07fcf05df851 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:11.936921 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72e83abe-4b0f-4e3f-9d81-07fcf05df851 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:11.937674 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72e83abe-4b0f-4e3f-9d81-07fcf05df851 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:11.938128 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72e83abe-4b0f-4e3f-9d81-07fcf05df851 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:12.014322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-72e83abe-4b0f-4e3f-9d81-07fcf05df851 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:12.022043 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-72e83abe-4b0f-4e3f-9d81-07fcf05df851 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1301 microversion: 2.1 time: 0.097765 Jul 12 13:19:12.022638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 278/557] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:11 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:12.085831 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ad8c9429-3e89-4d2f-9f4e-f3a63cd7ff04 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:12.086445 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ad8c9429-3e89-4d2f-9f4e-f3a63cd7ff04 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:12.093468 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad8c9429-3e89-4d2f-9f4e-f3a63cd7ff04 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:12.093921 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad8c9429-3e89-4d2f-9f4e-f3a63cd7ff04 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:12.094885 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad8c9429-3e89-4d2f-9f4e-f3a63cd7ff04 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:12.095350 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ad8c9429-3e89-4d2f-9f4e-f3a63cd7ff04 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:12.238784 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ad8c9429-3e89-4d2f-9f4e-f3a63cd7ff04 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:12.247244 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ad8c9429-3e89-4d2f-9f4e-f3a63cd7ff04 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.165235 Jul 12 13:19:12.247822 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 280/558] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:12 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:19:13.042835 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e355fdef-5df2-4c5f-8b52-2e4ee04a804f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:13.043762 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e355fdef-5df2-4c5f-8b52-2e4ee04a804f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:13.051298 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e355fdef-5df2-4c5f-8b52-2e4ee04a804f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:13.051707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e355fdef-5df2-4c5f-8b52-2e4ee04a804f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:13.053063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e355fdef-5df2-4c5f-8b52-2e4ee04a804f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:13.053181 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e355fdef-5df2-4c5f-8b52-2e4ee04a804f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:13.192245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e355fdef-5df2-4c5f-8b52-2e4ee04a804f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:13.200111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e355fdef-5df2-4c5f-8b52-2e4ee04a804f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.164299 Jul 12 13:19:13.200694 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 279/559] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:13 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:13.263942 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b6c29624-fdbc-413c-9e03-c4ee3ed7ceeb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:13.264640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b6c29624-fdbc-413c-9e03-c4ee3ed7ceeb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:13.271544 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6c29624-fdbc-413c-9e03-c4ee3ed7ceeb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:13.271976 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6c29624-fdbc-413c-9e03-c4ee3ed7ceeb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:13.272721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6c29624-fdbc-413c-9e03-c4ee3ed7ceeb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:13.273142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6c29624-fdbc-413c-9e03-c4ee3ed7ceeb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:13.412905 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b6c29624-fdbc-413c-9e03-c4ee3ed7ceeb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:13.425313 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b6c29624-fdbc-413c-9e03-c4ee3ed7ceeb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.165225 Jul 12 13:19:13.426079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 281/560] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:13 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:14.219984 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6ebf914d-c449-4b1b-b2ee-18143d06b0ca tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:14.220559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6ebf914d-c449-4b1b-b2ee-18143d06b0ca tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:14.227497 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ebf914d-c449-4b1b-b2ee-18143d06b0ca tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:14.227941 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ebf914d-c449-4b1b-b2ee-18143d06b0ca tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:14.228690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ebf914d-c449-4b1b-b2ee-18143d06b0ca tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:14.229113 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ebf914d-c449-4b1b-b2ee-18143d06b0ca tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:14.376423 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6ebf914d-c449-4b1b-b2ee-18143d06b0ca tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:14.384340 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6ebf914d-c449-4b1b-b2ee-18143d06b0ca tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.170028 Jul 12 13:19:14.384908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 280/561] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:14 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:14.447260 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b2358d21-27fd-4c2d-8208-703a87fab282 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:14.447847 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b2358d21-27fd-4c2d-8208-703a87fab282 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:14.455100 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b2358d21-27fd-4c2d-8208-703a87fab282 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:14.455546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b2358d21-27fd-4c2d-8208-703a87fab282 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:14.456301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b2358d21-27fd-4c2d-8208-703a87fab282 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:14.456730 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b2358d21-27fd-4c2d-8208-703a87fab282 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:14.600580 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b2358d21-27fd-4c2d-8208-703a87fab282 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:14.608877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b2358d21-27fd-4c2d-8208-703a87fab282 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.165622 Jul 12 13:19:14.609443 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 282/562] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:14 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:15.405818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9c51d33a-8ed1-4550-901e-62be167fea99 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:15.406933 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9c51d33a-8ed1-4550-901e-62be167fea99 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:15.418192 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c51d33a-8ed1-4550-901e-62be167fea99 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:15.418916 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c51d33a-8ed1-4550-901e-62be167fea99 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:15.420199 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c51d33a-8ed1-4550-901e-62be167fea99 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:15.420940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9c51d33a-8ed1-4550-901e-62be167fea99 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:15.554365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9c51d33a-8ed1-4550-901e-62be167fea99 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:15.562170 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9c51d33a-8ed1-4550-901e-62be167fea99 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.162826 Jul 12 13:19:15.562753 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 281/563] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:15 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:15.627909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-01cbb5fd-f5e8-499f-9f84-01c4bdcd21cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:15.628510 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-01cbb5fd-f5e8-499f-9f84-01c4bdcd21cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:15.635473 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-01cbb5fd-f5e8-499f-9f84-01c4bdcd21cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:15.635918 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-01cbb5fd-f5e8-499f-9f84-01c4bdcd21cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:15.636669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-01cbb5fd-f5e8-499f-9f84-01c4bdcd21cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:15.637100 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-01cbb5fd-f5e8-499f-9f84-01c4bdcd21cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:15.771473 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-01cbb5fd-f5e8-499f-9f84-01c4bdcd21cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:15.779869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-01cbb5fd-f5e8-499f-9f84-01c4bdcd21cb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.156989 Jul 12 13:19:15.780445 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 283/564] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:15 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:16.267738 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-f0d57907-dca1-42d0-a0e7-ef784fe098a2 req-1968a716-07c6-4a2b-9b5d-4d56ffbea1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9dca1a-25b5-4890-9c3a-33514d11fdd3", "tag": "6a9fdbcc-bc90-4cdd-9813-84987de6cb7e"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:16.277372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f0d57907-dca1-42d0-a0e7-ef784fe098a2 req-1968a716-07c6-4a2b-9b5d-4d56ffbea1e0 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:16.277932 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f0d57907-dca1-42d0-a0e7-ef784fe098a2 req-1968a716-07c6-4a2b-9b5d-4d56ffbea1e0 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:16.290631 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-f0d57907-dca1-42d0-a0e7-ef784fe098a2 req-1968a716-07c6-4a2b-9b5d-4d56ffbea1e0 service nova] Creating event network-changed:6a9fdbcc-bc90-4cdd-9813-84987de6cb7e for instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 on hv-cinder-79760 Jul 12 13:19:16.296473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-f0d57907-dca1-42d0-a0e7-ef784fe098a2 req-1968a716-07c6-4a2b-9b5d-4d56ffbea1e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033377 Jul 12 13:19:16.297573 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 282/565] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:16.580175 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9488206d-e134-4cf4-add3-a117eac7afeb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:16.581067 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9488206d-e134-4cf4-add3-a117eac7afeb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:16.587553 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9488206d-e134-4cf4-add3-a117eac7afeb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:16.587999 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9488206d-e134-4cf4-add3-a117eac7afeb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:16.588764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9488206d-e134-4cf4-add3-a117eac7afeb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:16.589197 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9488206d-e134-4cf4-add3-a117eac7afeb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:16.722328 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9488206d-e134-4cf4-add3-a117eac7afeb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:16.730026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9488206d-e134-4cf4-add3-a117eac7afeb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.154168 Jul 12 13:19:16.730597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 284/566] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:16 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:16.799340 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8fad239e-71f7-42aa-91b6-d17890db66ee tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:16.800153 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8fad239e-71f7-42aa-91b6-d17890db66ee tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:16.806509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8fad239e-71f7-42aa-91b6-d17890db66ee tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:16.806980 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8fad239e-71f7-42aa-91b6-d17890db66ee tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:16.807732 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8fad239e-71f7-42aa-91b6-d17890db66ee tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:16.808157 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8fad239e-71f7-42aa-91b6-d17890db66ee tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:16.946418 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8fad239e-71f7-42aa-91b6-d17890db66ee tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:16.955214 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8fad239e-71f7-42aa-91b6-d17890db66ee tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.160674 Jul 12 13:19:16.955769 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 283/567] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:16 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:17.747203 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-db080304-4ea1-4261-84b4-74d47952da1e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:17.747976 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-db080304-4ea1-4261-84b4-74d47952da1e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:17.755588 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-db080304-4ea1-4261-84b4-74d47952da1e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:17.756140 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-db080304-4ea1-4261-84b4-74d47952da1e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:17.757023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-db080304-4ea1-4261-84b4-74d47952da1e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:17.757488 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-db080304-4ea1-4261-84b4-74d47952da1e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:17.898763 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-db080304-4ea1-4261-84b4-74d47952da1e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:17.906887 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-db080304-4ea1-4261-84b4-74d47952da1e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.163632 Jul 12 13:19:17.908215 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 285/568] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:17 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:17.972845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-98532528-b5c5-45f0-9ed9-b25d83e73952 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:17.973521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-98532528-b5c5-45f0-9ed9-b25d83e73952 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:17.980001 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98532528-b5c5-45f0-9ed9-b25d83e73952 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:17.980771 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98532528-b5c5-45f0-9ed9-b25d83e73952 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:17.981534 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98532528-b5c5-45f0-9ed9-b25d83e73952 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:17.982471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98532528-b5c5-45f0-9ed9-b25d83e73952 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:18.156950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-98532528-b5c5-45f0-9ed9-b25d83e73952 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:18.165246 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-98532528-b5c5-45f0-9ed9-b25d83e73952 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.196962 Jul 12 13:19:18.165819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 284/569] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:17 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:19:18.925062 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-04233725-25e4-40a0-aea8-ef83d8af8112 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:18.925670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-04233725-25e4-40a0-aea8-ef83d8af8112 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:18.928186 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:18.933439 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04233725-25e4-40a0-aea8-ef83d8af8112 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:18.933871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04233725-25e4-40a0-aea8-ef83d8af8112 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:18.934611 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04233725-25e4-40a0-aea8-ef83d8af8112 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:18.935134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-04233725-25e4-40a0-aea8-ef83d8af8112 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:19.078866 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-04233725-25e4-40a0-aea8-ef83d8af8112 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:19.086386 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-04233725-25e4-40a0-aea8-ef83d8af8112 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.165426 Jul 12 13:19:19.086946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 286/570] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:18 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:19.185711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3312a69a-e314-4c96-9f20-0ff6cff36486 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:19.186261 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3312a69a-e314-4c96-9f20-0ff6cff36486 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:19.196682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3312a69a-e314-4c96-9f20-0ff6cff36486 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:19.197208 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3312a69a-e314-4c96-9f20-0ff6cff36486 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:19.198329 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3312a69a-e314-4c96-9f20-0ff6cff36486 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:19.198895 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3312a69a-e314-4c96-9f20-0ff6cff36486 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:19.337852 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3312a69a-e314-4c96-9f20-0ff6cff36486 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:19.345915 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3312a69a-e314-4c96-9f20-0ff6cff36486 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.166172 Jul 12 13:19:19.346504 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 285/571] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:19 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:20.103307 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fc5262dc-8c6d-49a1-8d61-e1c099672e7d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:20.103924 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fc5262dc-8c6d-49a1-8d61-e1c099672e7d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:20.111268 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc5262dc-8c6d-49a1-8d61-e1c099672e7d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:20.111710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc5262dc-8c6d-49a1-8d61-e1c099672e7d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:20.112463 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc5262dc-8c6d-49a1-8d61-e1c099672e7d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:20.112888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc5262dc-8c6d-49a1-8d61-e1c099672e7d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:20.252196 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fc5262dc-8c6d-49a1-8d61-e1c099672e7d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:20.259925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fc5262dc-8c6d-49a1-8d61-e1c099672e7d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.160579 Jul 12 13:19:20.260494 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 287/572] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:20 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:20.366559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c14d2ab3-7bbd-4e26-81ec-f40e405e80e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:20.367125 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c14d2ab3-7bbd-4e26-81ec-f40e405e80e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:20.377514 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c14d2ab3-7bbd-4e26-81ec-f40e405e80e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:20.378287 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c14d2ab3-7bbd-4e26-81ec-f40e405e80e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:20.379430 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c14d2ab3-7bbd-4e26-81ec-f40e405e80e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:20.379855 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c14d2ab3-7bbd-4e26-81ec-f40e405e80e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:20.545599 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c14d2ab3-7bbd-4e26-81ec-f40e405e80e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:20.554538 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c14d2ab3-7bbd-4e26-81ec-f40e405e80e0 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.193455 Jul 12 13:19:20.555117 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 286/573] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:20 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:21.278735 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cb43b113-ae26-4b7b-9f6b-fcee1f4286fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:21.279317 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cb43b113-ae26-4b7b-9f6b-fcee1f4286fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:21.281213 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:21.289120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cb43b113-ae26-4b7b-9f6b-fcee1f4286fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:21.289722 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cb43b113-ae26-4b7b-9f6b-fcee1f4286fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:21.290840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cb43b113-ae26-4b7b-9f6b-fcee1f4286fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:21.291559 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cb43b113-ae26-4b7b-9f6b-fcee1f4286fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:21.430880 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-cb43b113-ae26-4b7b-9f6b-fcee1f4286fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:21.440269 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cb43b113-ae26-4b7b-9f6b-fcee1f4286fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.165911 Jul 12 13:19:21.440817 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 288/574] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:21 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:21.572572 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8f82f6c2-b998-4af7-b3d9-1a0a61e51f83 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:21.573110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8f82f6c2-b998-4af7-b3d9-1a0a61e51f83 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:21.575081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:21.575759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=10 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:21.584514 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f82f6c2-b998-4af7-b3d9-1a0a61e51f83 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:21.585097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f82f6c2-b998-4af7-b3d9-1a0a61e51f83 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:21.586250 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f82f6c2-b998-4af7-b3d9-1a0a61e51f83 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:21.586695 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f82f6c2-b998-4af7-b3d9-1a0a61e51f83 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:21.726590 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8f82f6c2-b998-4af7-b3d9-1a0a61e51f83 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:21.734761 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8f82f6c2-b998-4af7-b3d9-1a0a61e51f83 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.166139 Jul 12 13:19:21.735354 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 287/575] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:21 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:22.099673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-5b529818-ab63-4444-bcee-7274343c63b7 req-05257f67-8de5-4a75-9d66-dbac9ce43394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9dca1a-25b5-4890-9c3a-33514d11fdd3", "name": "network-vif-plugged", "status": "completed", "tag": "6a9fdbcc-bc90-4cdd-9813-84987de6cb7e"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:22.107759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-5b529818-ab63-4444-bcee-7274343c63b7 req-05257f67-8de5-4a75-9d66-dbac9ce43394 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:22.108366 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-5b529818-ab63-4444-bcee-7274343c63b7 req-05257f67-8de5-4a75-9d66-dbac9ce43394 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:22.120240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-5b529818-ab63-4444-bcee-7274343c63b7 req-05257f67-8de5-4a75-9d66-dbac9ce43394 service nova] Creating event network-vif-plugged:6a9fdbcc-bc90-4cdd-9813-84987de6cb7e for instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 on hv-cinder-79760 Jul 12 13:19:22.125161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-5b529818-ab63-4444-bcee-7274343c63b7 req-05257f67-8de5-4a75-9d66-dbac9ce43394 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029250 Jul 12 13:19:22.125779 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 289/576] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:22.465657 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-440ce8cc-97bb-4f2b-b943-6e5280bbdd2f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:22.466632 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-440ce8cc-97bb-4f2b-b943-6e5280bbdd2f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:22.473998 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-440ce8cc-97bb-4f2b-b943-6e5280bbdd2f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:22.474450 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-440ce8cc-97bb-4f2b-b943-6e5280bbdd2f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:22.475230 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-440ce8cc-97bb-4f2b-b943-6e5280bbdd2f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:22.475653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-440ce8cc-97bb-4f2b-b943-6e5280bbdd2f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:22.622316 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-440ce8cc-97bb-4f2b-b943-6e5280bbdd2f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:22.630317 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-440ce8cc-97bb-4f2b-b943-6e5280bbdd2f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.171101 Jul 12 13:19:22.630874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 288/577] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:22 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:22.756306 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b124e0f5-8561-47fb-948a-f965be836cd1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:22.757319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b124e0f5-8561-47fb-948a-f965be836cd1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:22.766385 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b124e0f5-8561-47fb-948a-f965be836cd1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:22.766821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b124e0f5-8561-47fb-948a-f965be836cd1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:22.767624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b124e0f5-8561-47fb-948a-f965be836cd1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:22.768056 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b124e0f5-8561-47fb-948a-f965be836cd1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:22.904135 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b124e0f5-8561-47fb-948a-f965be836cd1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:22.915001 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b124e0f5-8561-47fb-948a-f965be836cd1 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.165229 Jul 12 13:19:22.915849 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 290/578] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:22 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:23.647466 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4842796f-09c2-4a96-b80f-d5c4c31688d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:23.648069 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4842796f-09c2-4a96-b80f-d5c4c31688d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:23.654820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4842796f-09c2-4a96-b80f-d5c4c31688d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:23.655388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4842796f-09c2-4a96-b80f-d5c4c31688d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:23.656147 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4842796f-09c2-4a96-b80f-d5c4c31688d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:23.656716 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4842796f-09c2-4a96-b80f-d5c4c31688d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:23.790591 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4842796f-09c2-4a96-b80f-d5c4c31688d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:23.798966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4842796f-09c2-4a96-b80f-d5c4c31688d1 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.155354 Jul 12 13:19:23.799552 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 289/579] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:23 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:23.934242 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3165ca44-a18f-470e-b2a2-99f66d5691ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:23.934872 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3165ca44-a18f-470e-b2a2-99f66d5691ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:23.942301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3165ca44-a18f-470e-b2a2-99f66d5691ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:23.942741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3165ca44-a18f-470e-b2a2-99f66d5691ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:23.943524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3165ca44-a18f-470e-b2a2-99f66d5691ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:23.943948 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3165ca44-a18f-470e-b2a2-99f66d5691ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:24.074485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3165ca44-a18f-470e-b2a2-99f66d5691ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:24.084469 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3165ca44-a18f-470e-b2a2-99f66d5691ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.154602 Jul 12 13:19:24.085284 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 291/580] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:23 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:24.819804 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-52ea8f15-75a5-474a-ad2c-c107116328ef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:24.820613 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-52ea8f15-75a5-474a-ad2c-c107116328ef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:24.831553 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52ea8f15-75a5-474a-ad2c-c107116328ef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:24.832273 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52ea8f15-75a5-474a-ad2c-c107116328ef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:24.833499 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52ea8f15-75a5-474a-ad2c-c107116328ef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:24.834203 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52ea8f15-75a5-474a-ad2c-c107116328ef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:24.975163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-52ea8f15-75a5-474a-ad2c-c107116328ef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:24.982845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-52ea8f15-75a5-474a-ad2c-c107116328ef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1366 microversion: 2.1 time: 0.170315 Jul 12 13:19:24.983518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 290/581] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:24 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:25.103015 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-38386268-d0ca-48b7-b600-1361addd1b00 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:25.103701 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-38386268-d0ca-48b7-b600-1361addd1b00 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:25.110873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-38386268-d0ca-48b7-b600-1361addd1b00 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:25.111342 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-38386268-d0ca-48b7-b600-1361addd1b00 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:25.112107 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-38386268-d0ca-48b7-b600-1361addd1b00 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:25.112536 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-38386268-d0ca-48b7-b600-1361addd1b00 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:25.256333 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-38386268-d0ca-48b7-b600-1361addd1b00 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:25.264402 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-38386268-d0ca-48b7-b600-1361addd1b00 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.165293 Jul 12 13:19:25.264943 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 292/582] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:25 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:25.556039 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0dfc4f3c-9b1e-485e-a333-22b88d1545ae tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:25.556574 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0dfc4f3c-9b1e-485e-a333-22b88d1545ae tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:25.564271 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0dfc4f3c-9b1e-485e-a333-22b88d1545ae tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:25.564718 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0dfc4f3c-9b1e-485e-a333-22b88d1545ae tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:25.565479 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0dfc4f3c-9b1e-485e-a333-22b88d1545ae tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:25.565906 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0dfc4f3c-9b1e-485e-a333-22b88d1545ae tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:25.592885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:25.597735 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0dfc4f3c-9b1e-485e-a333-22b88d1545ae tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments/9a6d20ef-7ffa-4f47-9b72-d2c709dd78a0" status: 200 len: 194 microversion: 2.20 time: 0.046894 Jul 12 13:19:25.598291 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 291/583] 10.222.0.33 () {60 vars in 1453 bytes} [Tue Jul 12 13:19:25 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments/9a6d20ef-7ffa-4f47-9b72-d2c709dd78a0 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:19:25.663265 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-da3d0da3-d703-43d9-9947-6aa0f9a0fe1f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:25.663759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-da3d0da3-d703-43d9-9947-6aa0f9a0fe1f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:25.670215 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-da3d0da3-d703-43d9-9947-6aa0f9a0fe1f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:25.670625 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-da3d0da3-d703-43d9-9947-6aa0f9a0fe1f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:25.672521 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-da3d0da3-d703-43d9-9947-6aa0f9a0fe1f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:25.673747 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-da3d0da3-d703-43d9-9947-6aa0f9a0fe1f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:25.775380 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-da3d0da3-d703-43d9-9947-6aa0f9a0fe1f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lazy-loading 'services' on Instance uuid 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:19:25.852334 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-da3d0da3-d703-43d9-9947-6aa0f9a0fe1f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "DELETE /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments/9a6d20ef-7ffa-4f47-9b72-d2c709dd78a0" status: 202 len: 0 microversion: 2.20 time: 0.192785 Jul 12 13:19:25.853014 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 293/584] 10.222.0.33 () {60 vars in 1456 bytes} [Tue Jul 12 13:19:25 2022] DELETE /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments/9a6d20ef-7ffa-4f47-9b72-d2c709dd78a0 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:19:25.862923 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ab81ced3-32f9-4d55-874c-971256471958 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:25.863846 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ab81ced3-32f9-4d55-874c-971256471958 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:25.870742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ab81ced3-32f9-4d55-874c-971256471958 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:25.871228 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ab81ced3-32f9-4d55-874c-971256471958 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:25.871985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ab81ced3-32f9-4d55-874c-971256471958 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:25.872413 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ab81ced3-32f9-4d55-874c-971256471958 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:25.904116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ab81ced3-32f9-4d55-874c-971256471958 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046207 Jul 12 13:19:25.904671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 292/585] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 12 13:19:25 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:19:26.002167 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a1777fcc-88af-4c00-8efc-ee79a83e245f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:26.002871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a1777fcc-88af-4c00-8efc-ee79a83e245f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:26.012523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a1777fcc-88af-4c00-8efc-ee79a83e245f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:26.013116 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a1777fcc-88af-4c00-8efc-ee79a83e245f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:26.014260 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a1777fcc-88af-4c00-8efc-ee79a83e245f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:26.014796 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a1777fcc-88af-4c00-8efc-ee79a83e245f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:26.152847 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a1777fcc-88af-4c00-8efc-ee79a83e245f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:26.156472 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:26.161099 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a1777fcc-88af-4c00-8efc-ee79a83e245f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1555 microversion: 2.1 time: 0.165065 Jul 12 13:19:26.161668 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 294/586] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:25 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:26.179004 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a59b437a-03de-45a5-83d8-28ec33538301 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:26.179498 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a59b437a-03de-45a5-83d8-28ec33538301 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:26.185869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a59b437a-03de-45a5-83d8-28ec33538301 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:26.186311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a59b437a-03de-45a5-83d8-28ec33538301 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:26.188648 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a59b437a-03de-45a5-83d8-28ec33538301 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:26.189088 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a59b437a-03de-45a5-83d8-28ec33538301 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:26.273017 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a59b437a-03de-45a5-83d8-28ec33538301 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097737 Jul 12 13:19:26.273802 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 293/587] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 12 13:19:26 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:26.286944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2c181e84-bc76-427a-b582-9445e2a82b0d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:26.287516 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2c181e84-bc76-427a-b582-9445e2a82b0d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:26.294254 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c181e84-bc76-427a-b582-9445e2a82b0d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:26.294694 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c181e84-bc76-427a-b582-9445e2a82b0d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:26.295467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c181e84-bc76-427a-b582-9445e2a82b0d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:26.295897 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c181e84-bc76-427a-b582-9445e2a82b0d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:26.430032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2c181e84-bc76-427a-b582-9445e2a82b0d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:26.438402 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2c181e84-bc76-427a-b582-9445e2a82b0d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1736 microversion: 2.1 time: 0.155753 Jul 12 13:19:26.439004 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 295/588] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:26 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:26.917500 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-14d4d0a5-59c4-493e-b5ea-3ca409843562 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:26.918992 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-14d4d0a5-59c4-493e-b5ea-3ca409843562 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:26.925922 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14d4d0a5-59c4-493e-b5ea-3ca409843562 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:26.926798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14d4d0a5-59c4-493e-b5ea-3ca409843562 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:26.927167 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14d4d0a5-59c4-493e-b5ea-3ca409843562 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:26.927644 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14d4d0a5-59c4-493e-b5ea-3ca409843562 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:26.961071 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-14d4d0a5-59c4-493e-b5ea-3ca409843562 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048471 Jul 12 13:19:26.961847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 294/589] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 12 13:19:26 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:19:27.255724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-aec32dfe-28fa-4917-a859-3cd8b40bc322 req-771dd4ff-c7bf-4d57-ac50-3929aff1559a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9dca1a-25b5-4890-9c3a-33514d11fdd3", "tag": "6a9fdbcc-bc90-4cdd-9813-84987de6cb7e"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:27.264263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-aec32dfe-28fa-4917-a859-3cd8b40bc322 req-771dd4ff-c7bf-4d57-ac50-3929aff1559a service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:27.264690 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-aec32dfe-28fa-4917-a859-3cd8b40bc322 req-771dd4ff-c7bf-4d57-ac50-3929aff1559a service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:27.276037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-aec32dfe-28fa-4917-a859-3cd8b40bc322 req-771dd4ff-c7bf-4d57-ac50-3929aff1559a service nova] Creating event network-changed:6a9fdbcc-bc90-4cdd-9813-84987de6cb7e for instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 on hv-cinder-79760 Jul 12 13:19:27.280948 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-aec32dfe-28fa-4917-a859-3cd8b40bc322 req-771dd4ff-c7bf-4d57-ac50-3929aff1559a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028802 Jul 12 13:19:27.281620 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 296/590] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:27.456540 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5800a267-7928-4d4e-aca1-079f498e75fe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:27.457282 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5800a267-7928-4d4e-aca1-079f498e75fe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:27.472984 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:27.478410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5800a267-7928-4d4e-aca1-079f498e75fe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:27.479266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5800a267-7928-4d4e-aca1-079f498e75fe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:27.481934 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5800a267-7928-4d4e-aca1-079f498e75fe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:27.482604 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5800a267-7928-4d4e-aca1-079f498e75fe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:27.680605 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5800a267-7928-4d4e-aca1-079f498e75fe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:27.689372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5800a267-7928-4d4e-aca1-079f498e75fe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1716 microversion: 2.1 time: 0.237611 Jul 12 13:19:27.689967 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 295/591] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:27 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1716 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:27.796360 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:27.796928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:27.803238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:27.803673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:27.804427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:27.804851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:27.888285 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] HTTP exception thrown: Cannot 'detach_volume' instance bd7df43b-4b7b-46af-ad37-d0267407bff2 while it is in vm_state rescued Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Request method failure captured: Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: DELETE /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments/0fe648e8-3da1-4991-b459-8cb71162e16a HTTP/1.1 Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPflp1o9WogLAsdDvmSYbq3haIRqeuf6GL6xU3vqmbsanSflHqREzYieLzIoopLz13Y8ZWtiAhuSzGa5XP_uWH_z5C9p8hYLodvCvW6njxHN9XLwyQv63XoytrSUUxgC1j1Sx9JqPFo9z2KdVjTsbxxebQxUx3vj0rtsuddM65GxVY Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: d175790280c1443192810e2b789b9926 Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:19:27.889899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d175790280c1443192810e2b789b9926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d175790280c1443192810e2b789b9926"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: d175790280c1443192810e2b789b9926 Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 9e08af1e7f794f85b57d6912db529577 Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:19:27.891957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Cannot 'detach_volume' instance bd7df43b-4b7b-46af-ad37-d0267407bff2 while it is in vm_state rescued Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'server_id': 'bd7df43b-4b7b-46af-ad37-d0267407bff2', 'id': '0fe648e8-3da1-4991-b459-8cb71162e16a'} Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd7df43b-4b7b-46af-ad37-d0267407bff2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:19:27.892775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bd7df43b-4b7b-46af-ad37-d0267407bff2 while it is in vm_state rescued Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bd7df43b-4b7b-46af-ad37-d0267407bff2 while it is in vm_state rescued Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:19:27.894726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Returning 409 to user: Cannot 'detach_volume' instance bd7df43b-4b7b-46af-ad37-d0267407bff2 while it is in vm_state rescued {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:19:27.895939 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d41b9796-cf27-4db1-bc40-9249c5ca4f69 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments/0fe648e8-3da1-4991-b459-8cb71162e16a" status: 409 len: 152 microversion: 2.1 time: 0.099763 Jul 12 13:19:27.898268 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 297/592] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:19:27 2022] DELETE /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments/0fe648e8-3da1-4991-b459-8cb71162e16a => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 13:19:27.900421 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-efe70049-3edd-480a-9284-65ece9cd31b3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:27.900959 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-efe70049-3edd-480a-9284-65ece9cd31b3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:27.907306 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-efe70049-3edd-480a-9284-65ece9cd31b3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:27.907749 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-efe70049-3edd-480a-9284-65ece9cd31b3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:27.908493 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-efe70049-3edd-480a-9284-65ece9cd31b3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:27.908950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-efe70049-3edd-480a-9284-65ece9cd31b3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:27.974219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e5f44175-91dc-40d8-a658-74b5d2ab7f91 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:27.975658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e5f44175-91dc-40d8-a658-74b5d2ab7f91 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:27.982904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5f44175-91dc-40d8-a658-74b5d2ab7f91 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:27.984596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5f44175-91dc-40d8-a658-74b5d2ab7f91 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:27.985695 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5f44175-91dc-40d8-a658-74b5d2ab7f91 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:27.986327 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5f44175-91dc-40d8-a658-74b5d2ab7f91 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:27.990658 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-efe70049-3edd-480a-9284-65ece9cd31b3 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "POST /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/action" status: 202 len: 0 microversion: 2.1 time: 0.093614 Jul 12 13:19:27.994907 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 296/593] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:19:27 2022] POST /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:19:28.007670 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4caccab4-6012-48f0-9634-5e2d94d0827b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:28.013691 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4caccab4-6012-48f0-9634-5e2d94d0827b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:28.022827 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4caccab4-6012-48f0-9634-5e2d94d0827b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:28.023440 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4caccab4-6012-48f0-9634-5e2d94d0827b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:28.027322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4caccab4-6012-48f0-9634-5e2d94d0827b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:28.027798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4caccab4-6012-48f0-9634-5e2d94d0827b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:28.032935 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e5f44175-91dc-40d8-a658-74b5d2ab7f91 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063031 Jul 12 13:19:28.033975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 298/594] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 12 13:19:27 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:19:28.562445 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4caccab4-6012-48f0-9634-5e2d94d0827b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:28.577792 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4caccab4-6012-48f0-9634-5e2d94d0827b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1724 microversion: 2.1 time: 0.581475 Jul 12 13:19:28.579354 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 297/595] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:27 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1724 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:29.045231 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9f0a9d8b-8d98-4d72-adae-9a7305693f16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:29.046190 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9f0a9d8b-8d98-4d72-adae-9a7305693f16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:29.052764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9f0a9d8b-8d98-4d72-adae-9a7305693f16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:29.053203 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9f0a9d8b-8d98-4d72-adae-9a7305693f16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:29.053955 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9f0a9d8b-8d98-4d72-adae-9a7305693f16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:29.054384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9f0a9d8b-8d98-4d72-adae-9a7305693f16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:29.083084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9f0a9d8b-8d98-4d72-adae-9a7305693f16 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042161 Jul 12 13:19:29.083778 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 299/596] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 12 13:19:29 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:29.141567 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-12b3c06b-2558-4f6f-b66e-c5a31427da9f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:29.142089 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-12b3c06b-2558-4f6f-b66e-c5a31427da9f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:29.148829 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-12b3c06b-2558-4f6f-b66e-c5a31427da9f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:29.149412 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-12b3c06b-2558-4f6f-b66e-c5a31427da9f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:29.150637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-12b3c06b-2558-4f6f-b66e-c5a31427da9f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:29.151088 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-12b3c06b-2558-4f6f-b66e-c5a31427da9f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:29.177222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-12b3c06b-2558-4f6f-b66e-c5a31427da9f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:19:29.259791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-12b3c06b-2558-4f6f-b66e-c5a31427da9f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "DELETE /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 204 len: 0 microversion: 2.20 time: 0.122069 Jul 12 13:19:29.263845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 298/597] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 12 13:19:29 2022] DELETE /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 13:19:29.269493 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:29.270105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:29.276891 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:29.277351 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:29.278087 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:29.278506 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:29.420071 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:29.429013 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:29.430490 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:29.431655 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d9c8532f-f324-4aad-bc3c-d1445968f986 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.166366 Jul 12 13:19:29.432174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 300/598] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:29 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:19:29.598759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a7d333b4-1f4b-4849-88e9-b78d77518515 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:29.599666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a7d333b4-1f4b-4849-88e9-b78d77518515 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:29.607796 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a7d333b4-1f4b-4849-88e9-b78d77518515 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:29.608342 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a7d333b4-1f4b-4849-88e9-b78d77518515 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:29.609460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a7d333b4-1f4b-4849-88e9-b78d77518515 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:29.609999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a7d333b4-1f4b-4849-88e9-b78d77518515 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:29.747323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a7d333b4-1f4b-4849-88e9-b78d77518515 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:29.755598 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a7d333b4-1f4b-4849-88e9-b78d77518515 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1724 microversion: 2.1 time: 0.162393 Jul 12 13:19:29.756165 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 299/599] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:29 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:30.451602 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:30.452227 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:30.459942 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:30.460384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:30.461138 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:30.461564 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:30.597609 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:30.606515 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:30.608250 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:30.609752 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8b9d9cf0-86cb-49b0-8348-0a4280f8a641 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.163478 Jul 12 13:19:30.610483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 301/600] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:30 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:30.776824 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-34ae881f-6732-49c7-a29c-6351ebff5327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:30.777850 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-34ae881f-6732-49c7-a29c-6351ebff5327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:30.786279 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34ae881f-6732-49c7-a29c-6351ebff5327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:30.786717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34ae881f-6732-49c7-a29c-6351ebff5327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:30.787521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34ae881f-6732-49c7-a29c-6351ebff5327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:30.787948 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-34ae881f-6732-49c7-a29c-6351ebff5327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:30.929848 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-34ae881f-6732-49c7-a29c-6351ebff5327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:30.938511 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-34ae881f-6732-49c7-a29c-6351ebff5327 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1724 microversion: 2.1 time: 0.168039 Jul 12 13:19:30.939171 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 300/601] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:30 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:31.632851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:31.633837 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:31.643746 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:31.644193 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:31.644953 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:31.645386 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:31.788140 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:31.796961 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:31.798502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:31.799695 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-62531a91-2aab-441a-a140-2781d2d7bf5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.173645 Jul 12 13:19:31.800251 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 302/602] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:31 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:31.965855 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8ec5812e-c436-47f9-958a-88e914df9a45 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:31.966524 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8ec5812e-c436-47f9-958a-88e914df9a45 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:31.975880 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8ec5812e-c436-47f9-958a-88e914df9a45 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:31.976463 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8ec5812e-c436-47f9-958a-88e914df9a45 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:31.977466 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8ec5812e-c436-47f9-958a-88e914df9a45 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:31.978029 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8ec5812e-c436-47f9-958a-88e914df9a45 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:32.126697 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8ec5812e-c436-47f9-958a-88e914df9a45 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:32.135717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8ec5812e-c436-47f9-958a-88e914df9a45 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1724 microversion: 2.1 time: 0.178967 Jul 12 13:19:32.136396 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 301/603] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:31 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:32.818165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:32.818796 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:32.825732 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:32.826111 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:32.826837 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:32.827336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:32.962698 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:32.970836 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:32.972340 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:32.973631 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-af3fb120-05d9-4458-8cdf-dd1fa93bc8ca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.159476 Jul 12 13:19:32.974192 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 303/604] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:32 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:33.153338 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f3a2ce1d-e5eb-4460-ab22-38d9ff0f289d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:33.154059 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f3a2ce1d-e5eb-4460-ab22-38d9ff0f289d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:33.160794 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f3a2ce1d-e5eb-4460-ab22-38d9ff0f289d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:33.161241 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f3a2ce1d-e5eb-4460-ab22-38d9ff0f289d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:33.162008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f3a2ce1d-e5eb-4460-ab22-38d9ff0f289d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:33.162438 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f3a2ce1d-e5eb-4460-ab22-38d9ff0f289d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:33.581650 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f3a2ce1d-e5eb-4460-ab22-38d9ff0f289d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:33.592038 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f3a2ce1d-e5eb-4460-ab22-38d9ff0f289d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1730 microversion: 2.1 time: 0.442586 Jul 12 13:19:33.593160 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 302/605] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:33 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1730 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:33.615037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f739ca30-b67c-41b4-bba8-eb034006b697 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:33.615819 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f739ca30-b67c-41b4-bba8-eb034006b697 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:33.623341 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f739ca30-b67c-41b4-bba8-eb034006b697 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:33.624054 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f739ca30-b67c-41b4-bba8-eb034006b697 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:33.627821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f739ca30-b67c-41b4-bba8-eb034006b697 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:33.628523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f739ca30-b67c-41b4-bba8-eb034006b697 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:33.717252 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f739ca30-b67c-41b4-bba8-eb034006b697 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109151 Jul 12 13:19:33.719405 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 304/606] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 12 13:19:33 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:33.998727 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:34.000200 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:34.007343 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:34.007917 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:34.008757 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:34.009252 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:34.292263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:34.305629 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:34.306937 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:34.308150 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-943fa9da-7088-40cd-bbd1-a8c9776640d8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1722 microversion: 2.20 time: 0.319363 Jul 12 13:19:34.308765 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 303/607] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:33 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:34.761733 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-dc26abcd-f541-4305-87c8-fcf02db60686 req-13fdc664-75b9-4f96-bcd5-a79f11582d0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7df43b-4b7b-46af-ad37-d0267407bff2", "tag": "2a046eef-1dcf-44d2-be29-2ae216e4b855"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:34.784912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-dc26abcd-f541-4305-87c8-fcf02db60686 req-13fdc664-75b9-4f96-bcd5-a79f11582d0d service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:34.785818 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-dc26abcd-f541-4305-87c8-fcf02db60686 req-13fdc664-75b9-4f96-bcd5-a79f11582d0d service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:34.822148 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-dc26abcd-f541-4305-87c8-fcf02db60686 req-13fdc664-75b9-4f96-bcd5-a79f11582d0d service nova] Creating event network-changed:2a046eef-1dcf-44d2-be29-2ae216e4b855 for instance bd7df43b-4b7b-46af-ad37-d0267407bff2 on hv-cinder-79760 Jul 12 13:19:34.847573 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-dc26abcd-f541-4305-87c8-fcf02db60686 req-13fdc664-75b9-4f96-bcd5-a79f11582d0d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089276 Jul 12 13:19:34.856302 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 305/608] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:34.950892 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-e9ff841f-d4c5-43c7-b2d7-78afdd9d83f1 req-01c0dca7-53be-4cf1-8228-7f7733eff48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a8f841-941e-4a72-a5c0-66cf4c1f7ebc", "name": "network-vif-deleted", "tag": "aecd26f4-285f-454f-8ddb-ecfc55407ec5"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:34.970365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-e9ff841f-d4c5-43c7-b2d7-78afdd9d83f1 req-01c0dca7-53be-4cf1-8228-7f7733eff48f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:34.971092 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-e9ff841f-d4c5-43c7-b2d7-78afdd9d83f1 req-01c0dca7-53be-4cf1-8228-7f7733eff48f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:34.994298 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-e9ff841f-d4c5-43c7-b2d7-78afdd9d83f1 req-01c0dca7-53be-4cf1-8228-7f7733eff48f service nova] Creating event network-vif-deleted:aecd26f4-285f-454f-8ddb-ecfc55407ec5 for instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc on hv-cinder-79760 Jul 12 13:19:35.008602 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-e9ff841f-d4c5-43c7-b2d7-78afdd9d83f1 req-01c0dca7-53be-4cf1-8228-7f7733eff48f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062442 Jul 12 13:19:35.014415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 304/609] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:35.327009 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:35.328138 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:35.337156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:35.337991 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:35.339738 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:35.340523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:35.379599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:35.380387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:35.381057 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lazy-loading 'fault' on Instance uuid 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:19:35.426618 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:35.440208 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:35.442079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:35.443603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3d613d2c-5936-4659-be1c-448c5668ce2e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 200 len: 1369 microversion: 2.20 time: 0.121355 Jul 12 13:19:35.455201 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 306/610] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:35 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 1369 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:36.463212 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:36.463989 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:36.471534 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:36.472119 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:36.472947 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:36.473536 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:36.489024 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] HTTP exception thrown: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Request method failure captured: Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc HTTP/1.1 Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPk0z5A-Lj4TbkQ-Fjid6UCVaqgOCy_DJXP51QGNEIJlypBHKTBsXVo7GZWHfuIYcUvpSaT2dXk0fGdhyiV_BbwGR5UL5ttTGotDN2dQIwGY_bRf8Q1sdnbS7Yt1xbaLMz8JTCnY1Qoi9cNMl4r6A0mm6z6gvUEeSInyZTJZd_0Ss8 Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:19:36.490871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69fbc5a39eab44419423278adc1cf201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 0b4bdaf5c1964d629cd417e41ff8a21c Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:19:36.492434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '07a8f841-941e-4a72-a5c0-66cf4c1f7ebc'} Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:19:36.493156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:19:36.494323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:19:36.496717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Returning 404 to user: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:19:36.497746 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6a05dc6a-8550-4e42-853c-a9c424f7e86d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 404 len: 111 microversion: 2.20 time: 0.039594 Jul 12 13:19:36.503640 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 305/611] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:36 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:19:36.508426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f3b6df13-dcbb-467f-be91-b0f90713e8c1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '.version_select at 0x7fd48cfa6e50>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:36.536833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f3b6df13-dcbb-467f-be91-b0f90713e8c1 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-30183758" status: 204 len: 0 microversion: 2.20 time: 0.032604 Jul 12 13:19:36.538108 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 307/612] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Jul 12 13:19:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-30183758 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 13:19:36.867410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-0f972f8d-0bf1-45da-a3a7-83a908778214 req-991e5cbf-198d-4b66-b8df-615091331c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7df43b-4b7b-46af-ad37-d0267407bff2", "tag": "2a046eef-1dcf-44d2-be29-2ae216e4b855"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:36.879009 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-0f972f8d-0bf1-45da-a3a7-83a908778214 req-991e5cbf-198d-4b66-b8df-615091331c77 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:36.879872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-0f972f8d-0bf1-45da-a3a7-83a908778214 req-991e5cbf-198d-4b66-b8df-615091331c77 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:36.893671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-0f972f8d-0bf1-45da-a3a7-83a908778214 req-991e5cbf-198d-4b66-b8df-615091331c77 service nova] Creating event network-changed:2a046eef-1dcf-44d2-be29-2ae216e4b855 for instance bd7df43b-4b7b-46af-ad37-d0267407bff2 on hv-cinder-79760 Jul 12 13:19:36.901725 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-0f972f8d-0bf1-45da-a3a7-83a908778214 req-991e5cbf-198d-4b66-b8df-615091331c77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039736 Jul 12 13:19:36.904302 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 306/613] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:19:37.711235 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a207ed79-ab48-41b9-ac68-71b264ac901e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'create', calling method: .version_select at 0x7fd48cfc2310>, body: {"keypair": {"name": "tempest-keypair-822687475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyLycNevNJvMD+OKgvIQ6T9JHXo0z/JkPRRJAoZnZvz1JFryFVAul2wqzKpWSx40pMg4a9vEzUXUUMnZeyGjW1YQGbxUohxpFiYp1D8JUqs2yxujmos6Jqk1h/xBhfrTw=="}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:37.730453 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-a207ed79-ab48-41b9-ac68-71b264ac901e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Getting quotas for project 69fbc5a39eab44419423278adc1cf201. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:19:37.735890 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-a207ed79-ab48-41b9-ac68-71b264ac901e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Getting quotas for user 0b4bdaf5c1964d629cd417e41ff8a21c and project 69fbc5a39eab44419423278adc1cf201. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:19:37.762169 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a207ed79-ab48-41b9-ac68-71b264ac901e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057647 Jul 12 13:19:37.762793 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 308/614] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Jul 12 13:19:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 13:19:39.531587 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1001159886", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d117129f-a685-47e6-ac3e-cac3ff34342b"}], "security_groups": [{"name": "tempest-securitygroup--2120048239"}], "key_name": "tempest-keypair-822687475", "user_data": "}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:39.645766 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] validate_networks() for [('d117129f-a685-47e6-ac3e-cac3ff34342b', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:19:40.130270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:19:40.130679 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:19:40.131172 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:19:40.131570 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:19:40.131972 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:19:40.143868 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:40.144586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:40.145513 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:40.148044 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:40.183631 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Getting quotas for project 69fbc5a39eab44419423278adc1cf201. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:19:40.192093 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Getting quotas for user 0b4bdaf5c1964d629cd417e41ff8a21c and project 69fbc5a39eab44419423278adc1cf201. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:19:40.206594 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:19:40.209464 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:19:40.291590 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0c5aa7f0-ee94-4301-a28e-bc761ca2348d tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.765308 Jul 12 13:19:40.293296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 307/615] 10.222.0.33 () {62 vars in 1187 bytes} [Tue Jul 12 13:19:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 13:19:40.304732 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d1af7253-379f-4b14-b1d2-7287347e0ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:40.306052 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d1af7253-379f-4b14-b1d2-7287347e0ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:40.386459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d1af7253-379f-4b14-b1d2-7287347e0ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:40.396356 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d1af7253-379f-4b14-b1d2-7287347e0ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:40.398197 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d1af7253-379f-4b14-b1d2-7287347e0ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:40.399598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d1af7253-379f-4b14-b1d2-7287347e0ed9 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1281 microversion: 2.20 time: 0.099256 Jul 12 13:19:40.400878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 309/616] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:40 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:41.423434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:41.431310 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:41.439369 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:41.440089 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:41.440979 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:41.441416 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:41.543829 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:41.550307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:41.557120 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:41.559191 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:41.562795 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-59411308-95d3-468c-8d11-f71a6cfc5d5c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1333 microversion: 2.20 time: 0.148203 Jul 12 13:19:41.565638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 308/617] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:41 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1333 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:42.585164 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:42.586575 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:42.601529 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:42.602346 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:42.603814 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:42.604473 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:42.918455 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:42.954408 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:42.958675 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:42.960102 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a2fb245e-a177-4b64-889c-d7c8087a1433 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1407 microversion: 2.20 time: 0.379611 Jul 12 13:19:42.960710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 310/618] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:42 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:43.599948 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-7631ec0f-b24c-4c7e-8e7e-125a9f822564 req-4faf0c11-1471-4250-94c9-ecb329b29578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc", "tag": "b51df1af-aa43-43ff-b70a-c0a6ec76b42b"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:43.615203 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-7631ec0f-b24c-4c7e-8e7e-125a9f822564 req-4faf0c11-1471-4250-94c9-ecb329b29578 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:43.616602 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-7631ec0f-b24c-4c7e-8e7e-125a9f822564 req-4faf0c11-1471-4250-94c9-ecb329b29578 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:43.646133 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-7631ec0f-b24c-4c7e-8e7e-125a9f822564 req-4faf0c11-1471-4250-94c9-ecb329b29578 service nova] Creating event network-changed:b51df1af-aa43-43ff-b70a-c0a6ec76b42b for instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc on hv-cinder-79760 Jul 12 13:19:43.654910 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-7631ec0f-b24c-4c7e-8e7e-125a9f822564 req-4faf0c11-1471-4250-94c9-ecb329b29578 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070411 Jul 12 13:19:43.661640 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 309/619] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:19:43.980557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:43.981262 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:43.988629 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:43.990134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:43.991183 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:43.991976 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:44.473166 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:44.481759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:44.483243 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:44.484360 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-db564fcb-15f2-4f00-a4c2-f35b696d2726 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1407 microversion: 2.20 time: 0.509202 Jul 12 13:19:44.484916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 311/620] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:43 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:19:45.505341 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:45.507357 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:45.525172 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:45.530820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:45.531620 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:45.532042 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:45.905978 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:45.933053 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:45.935799 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:45.937234 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-324049e4-a1e7-4b13-b3e1-2804b07764b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1407 microversion: 2.20 time: 0.437141 Jul 12 13:19:45.938457 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 310/621] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:45 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:46.959875 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:46.960634 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:46.967807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:46.968532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:46.969564 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:46.970574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:47.143247 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:47.152937 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:47.154917 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:47.156292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fe28d5b0-1e03-4402-8a5b-a5ccff2ddf66 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1407 microversion: 2.20 time: 0.202285 Jul 12 13:19:47.157609 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 312/622] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:46 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:48.173687 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:48.174327 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:48.180566 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:48.181014 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:48.182148 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:48.182275 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:48.348463 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:48.358862 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:48.360881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:48.362520 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ae67cb9d-0b71-40c0-a625-e1c9efc2c292 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1407 microversion: 2.20 time: 0.192865 Jul 12 13:19:48.364526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 311/623] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:48 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:49.388467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:49.390162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:49.399174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:49.412437 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:49.413154 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:49.414091 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:49.414666 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:49.502529 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-91201d01-3a9a-4450-9416-fc29f14c37ea req-f33f7759-4d76-4bdb-8d74-6bb9c63e58db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc", "name": "network-vif-plugged", "status": "completed", "tag": "b51df1af-aa43-43ff-b70a-c0a6ec76b42b"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:49.530518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-91201d01-3a9a-4450-9416-fc29f14c37ea req-f33f7759-4d76-4bdb-8d74-6bb9c63e58db service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:49.531291 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-91201d01-3a9a-4450-9416-fc29f14c37ea req-f33f7759-4d76-4bdb-8d74-6bb9c63e58db service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:49.554422 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-91201d01-3a9a-4450-9416-fc29f14c37ea req-f33f7759-4d76-4bdb-8d74-6bb9c63e58db service nova] Creating event network-vif-plugged:b51df1af-aa43-43ff-b70a-c0a6ec76b42b for instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc on hv-cinder-79760 Jul 12 13:19:49.560961 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-91201d01-3a9a-4450-9416-fc29f14c37ea req-f33f7759-4d76-4bdb-8d74-6bb9c63e58db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062438 Jul 12 13:19:49.561828 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 312/624] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:49.651668 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:49.666545 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:49.669991 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:49.674462 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-76aa3b83-4c62-4249-8e11-f7f6fca8fba6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1407 microversion: 2.20 time: 0.297431 Jul 12 13:19:49.675235 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 313/625] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:49 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:50.693367 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:50.696277 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:50.698413 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:50.699301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=6 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:50.717974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:50.718410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:50.719210 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:50.726232 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:50.879944 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:50.889071 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:50.890574 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:50.891713 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-43afa3ce-35ac-4248-a82b-46eebdb279fc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1407 microversion: 2.20 time: 0.202746 Jul 12 13:19:50.892562 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 313/626] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:50 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:51.912467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:51.913668 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:51.915938 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=6 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:51.924851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:51.925297 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:51.926079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:51.926521 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:52.129520 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:52.149007 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:52.154749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:52.156682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-17c2c134-81cd-40f2-931b-b4e78f407636 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1599 microversion: 2.20 time: 0.248686 Jul 12 13:19:52.158825 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 314/627] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:19:51 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1599 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:19:52.183405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ce228a9d-8967-464f-8ae6-03fedf186e34 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:52.184483 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ce228a9d-8967-464f-8ae6-03fedf186e34 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:52.191841 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ce228a9d-8967-464f-8ae6-03fedf186e34 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:52.192570 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ce228a9d-8967-464f-8ae6-03fedf186e34 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:52.193535 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ce228a9d-8967-464f-8ae6-03fedf186e34 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:52.194031 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ce228a9d-8967-464f-8ae6-03fedf186e34 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:52.277800 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ce228a9d-8967-464f-8ae6-03fedf186e34 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098490 Jul 12 13:19:52.279300 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 314/628] 10.222.0.33 () {60 vars in 1315 bytes} [Tue Jul 12 13:19:52 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:19:53.344170 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-5d28dbed-26ee-4c4c-b627-801db249bc0b req-9cf75259-aed7-48e0-b7fe-66c7e21186fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc", "tag": "b51df1af-aa43-43ff-b70a-c0a6ec76b42b"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:53.353601 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-5d28dbed-26ee-4c4c-b627-801db249bc0b req-9cf75259-aed7-48e0-b7fe-66c7e21186fd service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:53.354446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-5d28dbed-26ee-4c4c-b627-801db249bc0b req-9cf75259-aed7-48e0-b7fe-66c7e21186fd service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:53.368049 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-5d28dbed-26ee-4c4c-b627-801db249bc0b req-9cf75259-aed7-48e0-b7fe-66c7e21186fd service nova] Creating event network-changed:b51df1af-aa43-43ff-b70a-c0a6ec76b42b for instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc on hv-cinder-79760 Jul 12 13:19:53.373623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-5d28dbed-26ee-4c4c-b627-801db249bc0b req-9cf75259-aed7-48e0-b7fe-66c7e21186fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033078 Jul 12 13:19:53.374810 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 315/629] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:56.343084 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bdaa9698-3c84-49b0-ab92-aab909f07f76 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Action: 'create', calling method: .version_select at 0x7fd48d142310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1438628514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTv1XQe7yksJdVW3fNdRIJqtmF0li3ktxknf4Q6lirnRapspoWcsTJeVwrGMW0Z0KoqIJzeUx3x96ZWHVytq1HmSaFe6PDcpKZ4NiZUQevbEAWPGBfguILP8FJ1JTjisw=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:56.358195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-bdaa9698-3c84-49b0-ab92-aab909f07f76 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Getting quotas for project 7ba94948f8ed41e3a3a9052aa2320f24. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:19:56.362586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-bdaa9698-3c84-49b0-ab92-aab909f07f76 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Getting quotas for user e3bb2983cd4a4e27a73d46101fafea23 and project 7ba94948f8ed41e3a3a9052aa2320f24. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:19:56.389206 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bdaa9698-3c84-49b0-ab92-aab909f07f76 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050503 Jul 12 13:19:56.389783 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 315/630] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:19:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:19:56.444111 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-189135742", "imageRef": "9ab1dc8a-d386-43cd-9dff-b72794f8df98", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1438628514", "networks": [{"uuid": "29758d59-92ca-4b59-95f8-dad9c1d47988"}]}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:56.494971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] validate_networks() for [('29758d59-92ca-4b59-95f8-dad9c1d47988', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:19:56.889665 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:19:56.890166 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:19:56.890635 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:19:56.891078 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:19:56.891543 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:19:56.900853 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:56.901324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:56.902118 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:56.902528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:56.908556 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=97 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:56.921629 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Getting quotas for project 7ba94948f8ed41e3a3a9052aa2320f24. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:19:56.926011 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Getting quotas for user e3bb2983cd4a4e27a73d46101fafea23 and project 7ba94948f8ed41e3a3a9052aa2320f24. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:19:56.937310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:19:56.939794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ab1dc8a-d386-43cd-9dff-b72794f8df98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:19:56.985058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-49da1b61-c2a4-405e-93f0-aeeb58fe7db0 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546327 Jul 12 13:19:56.986134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 316/631] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:19:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:19:56.996140 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bc83f06e-cc7d-45e9-80ca-d278723990c7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:56.996771 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bc83f06e-cc7d-45e9-80ca-d278723990c7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:57.052505 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bc83f06e-cc7d-45e9-80ca-d278723990c7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:57.060595 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bc83f06e-cc7d-45e9-80ca-d278723990c7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1258 microversion: 2.1 time: 0.068549 Jul 12 13:19:57.061181 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 316/632] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:56 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:58.078249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a60f61fa-7210-4531-89f7-a172884572ff tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:58.078833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a60f61fa-7210-4531-89f7-a172884572ff tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:58.086273 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a60f61fa-7210-4531-89f7-a172884572ff tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:58.086716 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a60f61fa-7210-4531-89f7-a172884572ff tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:58.087572 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a60f61fa-7210-4531-89f7-a172884572ff tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:58.088009 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a60f61fa-7210-4531-89f7-a172884572ff tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:58.153337 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a60f61fa-7210-4531-89f7-a172884572ff tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:58.162154 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a60f61fa-7210-4531-89f7-a172884572ff tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1318 microversion: 2.1 time: 0.088000 Jul 12 13:19:58.163274 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 317/633] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:58 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1318 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:59.179698 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f5c8f440-f2b3-4bfa-9e02-39953b930416 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:59.180974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f5c8f440-f2b3-4bfa-9e02-39953b930416 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:59.183561 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:19:59.195543 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f5c8f440-f2b3-4bfa-9e02-39953b930416 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:59.196264 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f5c8f440-f2b3-4bfa-9e02-39953b930416 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:59.197278 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f5c8f440-f2b3-4bfa-9e02-39953b930416 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:59.197857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f5c8f440-f2b3-4bfa-9e02-39953b930416 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:59.451774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8502ba62-5a84-4d7d-87fa-2661a902fa14 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:19:59.452347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8502ba62-5a84-4d7d-87fa-2661a902fa14 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:59.459658 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8502ba62-5a84-4d7d-87fa-2661a902fa14 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:59.460416 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8502ba62-5a84-4d7d-87fa-2661a902fa14 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:59.461404 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8502ba62-5a84-4d7d-87fa-2661a902fa14 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:59.462030 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8502ba62-5a84-4d7d-87fa-2661a902fa14 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:59.485923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-8502ba62-5a84-4d7d-87fa-2661a902fa14 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lazy-loading 'flavor' on Instance uuid 5c1b8589-d954-4806-9228-47ea80451712 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:19:59.538987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f5c8f440-f2b3-4bfa-9e02-39953b930416 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:59.548259 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f5c8f440-f2b3-4bfa-9e02-39953b930416 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.372531 Jul 12 13:19:59.549270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 317/634] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:59 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:19:59.577263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8502ba62-5a84-4d7d-87fa-2661a902fa14 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "POST /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712/action" status: 202 len: 0 microversion: 2.1 time: 0.129280 Jul 12 13:19:59.577891 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 318/635] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:19:59 2022] POST /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 13:19:59.587113 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ec7ed996-4874-4563-80c4-7a1a97c23624 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:19:59.587993 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ec7ed996-4874-4563-80c4-7a1a97c23624 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:19:59.594721 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec7ed996-4874-4563-80c4-7a1a97c23624 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:59.595542 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec7ed996-4874-4563-80c4-7a1a97c23624 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:59.596380 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec7ed996-4874-4563-80c4-7a1a97c23624 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:19:59.596816 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ec7ed996-4874-4563-80c4-7a1a97c23624 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:19:59.741746 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ec7ed996-4874-4563-80c4-7a1a97c23624 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:19:59.749206 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ec7ed996-4874-4563-80c4-7a1a97c23624 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.165950 Jul 12 13:19:59.749852 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 318/636] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:19:59 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:00.576415 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a09cff25-39ec-4321-af12-04fb67a9b971 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:00.577488 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a09cff25-39ec-4321-af12-04fb67a9b971 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:00.585174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a09cff25-39ec-4321-af12-04fb67a9b971 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:00.585841 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a09cff25-39ec-4321-af12-04fb67a9b971 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:00.586841 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a09cff25-39ec-4321-af12-04fb67a9b971 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:00.587474 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a09cff25-39ec-4321-af12-04fb67a9b971 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:00.767053 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e2dcbe2d-7490-4ae5-a709-87e60d8b03e4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:00.768167 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e2dcbe2d-7490-4ae5-a709-87e60d8b03e4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:00.774616 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e2dcbe2d-7490-4ae5-a709-87e60d8b03e4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:00.775196 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e2dcbe2d-7490-4ae5-a709-87e60d8b03e4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:00.776038 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e2dcbe2d-7490-4ae5-a709-87e60d8b03e4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:00.776540 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e2dcbe2d-7490-4ae5-a709-87e60d8b03e4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:00.779922 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a09cff25-39ec-4321-af12-04fb67a9b971 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:00.787676 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a09cff25-39ec-4321-af12-04fb67a9b971 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.224458 Jul 12 13:20:00.788524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 319/637] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:00 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:00.920165 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e2dcbe2d-7490-4ae5-a709-87e60d8b03e4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:00.928160 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e2dcbe2d-7490-4ae5-a709-87e60d8b03e4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.165062 Jul 12 13:20:00.929040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 319/638] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:00 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:01.808440 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ab88086d-cf8a-4b51-a94d-cc0c9b34544c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:01.809570 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ab88086d-cf8a-4b51-a94d-cc0c9b34544c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:01.820106 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ab88086d-cf8a-4b51-a94d-cc0c9b34544c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:01.820821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ab88086d-cf8a-4b51-a94d-cc0c9b34544c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:01.821962 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ab88086d-cf8a-4b51-a94d-cc0c9b34544c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:01.822617 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ab88086d-cf8a-4b51-a94d-cc0c9b34544c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:01.950893 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-51499211-58ad-4b0f-8c85-575519878be6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:01.952285 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-51499211-58ad-4b0f-8c85-575519878be6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:01.962843 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ab88086d-cf8a-4b51-a94d-cc0c9b34544c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:01.971414 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51499211-58ad-4b0f-8c85-575519878be6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:01.971860 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ab88086d-cf8a-4b51-a94d-cc0c9b34544c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.169144 Jul 12 13:20:01.972439 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51499211-58ad-4b0f-8c85-575519878be6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:01.979659 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51499211-58ad-4b0f-8c85-575519878be6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:01.980624 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-51499211-58ad-4b0f-8c85-575519878be6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:01.982421 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 320/639] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:01 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:02.117485 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-51499211-58ad-4b0f-8c85-575519878be6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:02.125070 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-51499211-58ad-4b0f-8c85-575519878be6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.183026 Jul 12 13:20:02.125638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 320/640] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:01 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:02.990000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9d20aebc-6fd0-4513-9275-bb2b43fcf34a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:02.993636 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9d20aebc-6fd0-4513-9275-bb2b43fcf34a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:03.010745 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9d20aebc-6fd0-4513-9275-bb2b43fcf34a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:03.011210 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9d20aebc-6fd0-4513-9275-bb2b43fcf34a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:03.011943 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9d20aebc-6fd0-4513-9275-bb2b43fcf34a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:03.012579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9d20aebc-6fd0-4513-9275-bb2b43fcf34a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:03.143645 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c05f0c93-6a74-4061-af1a-fc4b41148f03 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:03.144280 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c05f0c93-6a74-4061-af1a-fc4b41148f03 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:03.146585 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9d20aebc-6fd0-4513-9275-bb2b43fcf34a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:03.151113 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c05f0c93-6a74-4061-af1a-fc4b41148f03 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:03.151559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c05f0c93-6a74-4061-af1a-fc4b41148f03 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:03.152320 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c05f0c93-6a74-4061-af1a-fc4b41148f03 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:03.152745 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c05f0c93-6a74-4061-af1a-fc4b41148f03 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:03.155274 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9d20aebc-6fd0-4513-9275-bb2b43fcf34a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.169240 Jul 12 13:20:03.155802 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 321/641] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:02 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:03.291594 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c05f0c93-6a74-4061-af1a-fc4b41148f03 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:03.301553 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c05f0c93-6a74-4061-af1a-fc4b41148f03 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.162415 Jul 12 13:20:03.302130 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 321/642] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:03 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:04.173036 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f1c4065a-151e-4e2b-90e5-77bbf48827ac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:04.173648 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f1c4065a-151e-4e2b-90e5-77bbf48827ac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:04.180647 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1c4065a-151e-4e2b-90e5-77bbf48827ac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:04.181085 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1c4065a-151e-4e2b-90e5-77bbf48827ac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:04.181834 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1c4065a-151e-4e2b-90e5-77bbf48827ac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:04.182259 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1c4065a-151e-4e2b-90e5-77bbf48827ac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:04.319528 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a018b903-702d-4276-a648-6654fbb8e31a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:04.320218 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a018b903-702d-4276-a648-6654fbb8e31a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:04.326871 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a018b903-702d-4276-a648-6654fbb8e31a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:04.327397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a018b903-702d-4276-a648-6654fbb8e31a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:04.328230 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a018b903-702d-4276-a648-6654fbb8e31a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:04.328660 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a018b903-702d-4276-a648-6654fbb8e31a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:04.331550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f1c4065a-151e-4e2b-90e5-77bbf48827ac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:04.339619 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f1c4065a-151e-4e2b-90e5-77bbf48827ac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.170553 Jul 12 13:20:04.340330 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 322/643] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:04 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:04.473387 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a018b903-702d-4276-a648-6654fbb8e31a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:04.481188 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a018b903-702d-4276-a648-6654fbb8e31a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.166108 Jul 12 13:20:04.481665 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 322/644] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:04 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:05.357528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-496197e0-6b91-43de-aa38-a125b834de24 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:05.358198 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-496197e0-6b91-43de-aa38-a125b834de24 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:05.365381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-496197e0-6b91-43de-aa38-a125b834de24 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:05.365827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-496197e0-6b91-43de-aa38-a125b834de24 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:05.366595 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-496197e0-6b91-43de-aa38-a125b834de24 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:05.367064 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-496197e0-6b91-43de-aa38-a125b834de24 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:05.499030 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-496197e0-6b91-43de-aa38-a125b834de24 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:05.499253 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bd280407-2a34-4e70-b9fc-c20ff3dc5155 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:05.499899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bd280407-2a34-4e70-b9fc-c20ff3dc5155 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:05.509336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-496197e0-6b91-43de-aa38-a125b834de24 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.155496 Jul 12 13:20:05.509533 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bd280407-2a34-4e70-b9fc-c20ff3dc5155 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:05.510009 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 323/645] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:05 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:05.510125 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bd280407-2a34-4e70-b9fc-c20ff3dc5155 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:05.510878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bd280407-2a34-4e70-b9fc-c20ff3dc5155 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:05.511349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bd280407-2a34-4e70-b9fc-c20ff3dc5155 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:05.642234 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bd280407-2a34-4e70-b9fc-c20ff3dc5155 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:05.650434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bd280407-2a34-4e70-b9fc-c20ff3dc5155 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.156283 Jul 12 13:20:05.651005 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 323/646] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:05 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:06.530600 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-294bfe4e-a73d-44bb-8a44-ece32ad728da tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:06.531334 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-294bfe4e-a73d-44bb-8a44-ece32ad728da tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:06.547654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-294bfe4e-a73d-44bb-8a44-ece32ad728da tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:06.548088 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-294bfe4e-a73d-44bb-8a44-ece32ad728da tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:06.548848 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-294bfe4e-a73d-44bb-8a44-ece32ad728da tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:06.549411 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-294bfe4e-a73d-44bb-8a44-ece32ad728da tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:06.668366 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7eea7000-a1fd-4778-9936-c35ee0bd325a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:06.669254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7eea7000-a1fd-4778-9936-c35ee0bd325a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:06.681911 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7eea7000-a1fd-4778-9936-c35ee0bd325a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:06.682452 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7eea7000-a1fd-4778-9936-c35ee0bd325a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:06.683350 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7eea7000-a1fd-4778-9936-c35ee0bd325a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:06.683847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7eea7000-a1fd-4778-9936-c35ee0bd325a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:06.702466 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-294bfe4e-a73d-44bb-8a44-ece32ad728da tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:06.710414 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-294bfe4e-a73d-44bb-8a44-ece32ad728da tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.187807 Jul 12 13:20:06.714124 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 324/647] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:06 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:06.844336 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7eea7000-a1fd-4778-9936-c35ee0bd325a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:06.855168 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7eea7000-a1fd-4778-9936-c35ee0bd325a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.191021 Jul 12 13:20:06.855939 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 324/648] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:06 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:07.726447 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2ca93733-b51b-4a07-b893-f34fd725f49c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:07.727222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2ca93733-b51b-4a07-b893-f34fd725f49c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:07.729043 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:07.729740 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=6 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:07.736428 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2ca93733-b51b-4a07-b893-f34fd725f49c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:07.737018 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2ca93733-b51b-4a07-b893-f34fd725f49c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:07.737793 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2ca93733-b51b-4a07-b893-f34fd725f49c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:07.738191 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2ca93733-b51b-4a07-b893-f34fd725f49c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:07.873066 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0bb056b0-0e54-4cce-8a3c-21ca2aa9e9a9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:07.873601 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2ca93733-b51b-4a07-b893-f34fd725f49c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:07.873722 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0bb056b0-0e54-4cce-8a3c-21ca2aa9e9a9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:07.875530 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=6 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:07.882178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bb056b0-0e54-4cce-8a3c-21ca2aa9e9a9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:07.882466 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2ca93733-b51b-4a07-b893-f34fd725f49c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.160018 Jul 12 13:20:07.882634 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bb056b0-0e54-4cce-8a3c-21ca2aa9e9a9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:07.883329 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 325/649] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:07 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:07.883581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bb056b0-0e54-4cce-8a3c-21ca2aa9e9a9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:07.884098 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0bb056b0-0e54-4cce-8a3c-21ca2aa9e9a9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:08.017057 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0bb056b0-0e54-4cce-8a3c-21ca2aa9e9a9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:08.028047 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0bb056b0-0e54-4cce-8a3c-21ca2aa9e9a9 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.158276 Jul 12 13:20:08.028517 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 325/650] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:07 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:08.902320 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9e06c9c1-c0da-4cf4-989b-0063f621688a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:08.902929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9e06c9c1-c0da-4cf4-989b-0063f621688a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:08.912077 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9e06c9c1-c0da-4cf4-989b-0063f621688a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:08.912515 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9e06c9c1-c0da-4cf4-989b-0063f621688a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:08.913269 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9e06c9c1-c0da-4cf4-989b-0063f621688a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:08.913693 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9e06c9c1-c0da-4cf4-989b-0063f621688a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:09.045411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fb553ffa-35e4-4b37-9d44-76d7edade0ee tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:09.046028 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fb553ffa-35e4-4b37-9d44-76d7edade0ee tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:09.046224 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9e06c9c1-c0da-4cf4-989b-0063f621688a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:09.053484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fb553ffa-35e4-4b37-9d44-76d7edade0ee tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:09.053869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fb553ffa-35e4-4b37-9d44-76d7edade0ee tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:09.054652 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fb553ffa-35e4-4b37-9d44-76d7edade0ee tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:09.055130 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fb553ffa-35e4-4b37-9d44-76d7edade0ee tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:09.055808 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9e06c9c1-c0da-4cf4-989b-0063f621688a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.159524 Jul 12 13:20:09.066987 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 326/651] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:08 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:09.223902 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fb553ffa-35e4-4b37-9d44-76d7edade0ee tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:09.233055 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fb553ffa-35e4-4b37-9d44-76d7edade0ee tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.190453 Jul 12 13:20:09.233697 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 326/652] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:09 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:10.079238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e4ecf5e7-e110-4c1b-85b6-d457e47d9462 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:10.079900 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e4ecf5e7-e110-4c1b-85b6-d457e47d9462 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:10.087150 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e4ecf5e7-e110-4c1b-85b6-d457e47d9462 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:10.087960 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e4ecf5e7-e110-4c1b-85b6-d457e47d9462 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:10.088975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e4ecf5e7-e110-4c1b-85b6-d457e47d9462 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:10.089799 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e4ecf5e7-e110-4c1b-85b6-d457e47d9462 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:10.224174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e4ecf5e7-e110-4c1b-85b6-d457e47d9462 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:10.232013 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e4ecf5e7-e110-4c1b-85b6-d457e47d9462 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.156795 Jul 12 13:20:10.232587 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 327/653] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:10 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:10.250906 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-36533c1e-86e5-40e0-b34a-0d776aa807ba tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:10.251538 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-36533c1e-86e5-40e0-b34a-0d776aa807ba tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:10.260088 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36533c1e-86e5-40e0-b34a-0d776aa807ba tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:10.260706 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36533c1e-86e5-40e0-b34a-0d776aa807ba tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:10.261896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36533c1e-86e5-40e0-b34a-0d776aa807ba tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:10.262629 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36533c1e-86e5-40e0-b34a-0d776aa807ba tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:10.418878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-36533c1e-86e5-40e0-b34a-0d776aa807ba tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:10.430519 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-36533c1e-86e5-40e0-b34a-0d776aa807ba tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.183272 Jul 12 13:20:10.431288 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 327/654] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:10 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:11.132328 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e0c6c8bb-5aa8-4dd8-a24c-7efe44011329 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:11.133052 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e0c6c8bb-5aa8-4dd8-a24c-7efe44011329 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:11.139914 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0c6c8bb-5aa8-4dd8-a24c-7efe44011329 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:11.140358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0c6c8bb-5aa8-4dd8-a24c-7efe44011329 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:11.141103 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0c6c8bb-5aa8-4dd8-a24c-7efe44011329 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:11.141530 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0c6c8bb-5aa8-4dd8-a24c-7efe44011329 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:11.164580 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e0c6c8bb-5aa8-4dd8-a24c-7efe44011329 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/ips" status: 200 len: 148 microversion: 2.1 time: 0.036218 Jul 12 13:20:11.165137 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 328/655] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:20:11 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:11.249307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-991a675d-616a-4e94-9afb-33be7714922c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:11.249927 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-991a675d-616a-4e94-9afb-33be7714922c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:11.257243 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-991a675d-616a-4e94-9afb-33be7714922c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:11.257893 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-991a675d-616a-4e94-9afb-33be7714922c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:11.258444 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-991a675d-616a-4e94-9afb-33be7714922c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:11.258886 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-991a675d-616a-4e94-9afb-33be7714922c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:11.391073 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-991a675d-616a-4e94-9afb-33be7714922c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:11.401307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-991a675d-616a-4e94-9afb-33be7714922c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.155861 Jul 12 13:20:11.401899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 328/656] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:11 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:11.451086 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8b244106-78cc-4f11-9419-e4236e51c8a5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:11.451704 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8b244106-78cc-4f11-9419-e4236e51c8a5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:11.459229 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8b244106-78cc-4f11-9419-e4236e51c8a5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:11.459808 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8b244106-78cc-4f11-9419-e4236e51c8a5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:11.460690 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8b244106-78cc-4f11-9419-e4236e51c8a5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:11.461223 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8b244106-78cc-4f11-9419-e4236e51c8a5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:11.622603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8b244106-78cc-4f11-9419-e4236e51c8a5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:11.630458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8b244106-78cc-4f11-9419-e4236e51c8a5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.183223 Jul 12 13:20:11.631037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 329/657] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:11 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:12.417986 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-398d4800-7ba5-4654-95cf-623ea66a1098 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:12.418600 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-398d4800-7ba5-4654-95cf-623ea66a1098 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:12.425302 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-398d4800-7ba5-4654-95cf-623ea66a1098 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:12.425760 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-398d4800-7ba5-4654-95cf-623ea66a1098 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:12.426509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-398d4800-7ba5-4654-95cf-623ea66a1098 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:12.426947 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-398d4800-7ba5-4654-95cf-623ea66a1098 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:12.431036 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:12.500270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-119fb35e-160f-4797-8409-285e93c7af7a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08154c6e-d7be-4e1a-885d-2dfb300af6d8"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:12.501058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-119fb35e-160f-4797-8409-285e93c7af7a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:12.508053 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-119fb35e-160f-4797-8409-285e93c7af7a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:12.508507 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-119fb35e-160f-4797-8409-285e93c7af7a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:12.509269 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-119fb35e-160f-4797-8409-285e93c7af7a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:12.509696 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-119fb35e-160f-4797-8409-285e93c7af7a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:12.576471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-398d4800-7ba5-4654-95cf-623ea66a1098 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:12.591204 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-398d4800-7ba5-4654-95cf-623ea66a1098 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.176596 Jul 12 13:20:12.591807 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 329/658] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:12 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:12.648896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8e01dd9a-892c-4220-a709-0f642eb4e8cf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:12.649690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8e01dd9a-892c-4220-a709-0f642eb4e8cf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:12.659029 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e01dd9a-892c-4220-a709-0f642eb4e8cf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:12.659406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e01dd9a-892c-4220-a709-0f642eb4e8cf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:12.660152 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e01dd9a-892c-4220-a709-0f642eb4e8cf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:12.660571 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e01dd9a-892c-4220-a709-0f642eb4e8cf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:12.799673 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8e01dd9a-892c-4220-a709-0f642eb4e8cf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:12.807636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8e01dd9a-892c-4220-a709-0f642eb4e8cf tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.163746 Jul 12 13:20:12.808212 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 330/659] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:12 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:12.813173 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c382a335-30be-410e-9568-bcfc0b16ec71 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:12.813661 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c382a335-30be-410e-9568-bcfc0b16ec71 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:12.819557 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c382a335-30be-410e-9568-bcfc0b16ec71 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:12.820002 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c382a335-30be-410e-9568-bcfc0b16ec71 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:12.820754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c382a335-30be-410e-9568-bcfc0b16ec71 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:12.821179 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c382a335-30be-410e-9568-bcfc0b16ec71 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:12.957468 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-c382a335-30be-410e-9568-bcfc0b16ec71 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lazy-loading 'services' on Instance uuid bd7df43b-4b7b-46af-ad37-d0267407bff2 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:20:13.077182 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c382a335-30be-410e-9568-bcfc0b16ec71 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments/0fe648e8-3da1-4991-b459-8cb71162e16a" status: 202 len: 0 microversion: 2.1 time: 0.267364 Jul 12 13:20:13.077839 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 331/660] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:20:12 2022] DELETE /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments/0fe648e8-3da1-4991-b459-8cb71162e16a => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:20:13.193325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e3637295-a68e-4487-924e-993ef119437e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:13.194430 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e3637295-a68e-4487-924e-993ef119437e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:13.201105 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e3637295-a68e-4487-924e-993ef119437e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:13.201554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e3637295-a68e-4487-924e-993ef119437e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:13.202471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e3637295-a68e-4487-924e-993ef119437e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:13.202873 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e3637295-a68e-4487-924e-993ef119437e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:13.240351 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e3637295-a68e-4487-924e-993ef119437e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157493 Jul 12 13:20:13.241095 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 332/661] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:20:13 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:20:13.587523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:13.607813 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-119fb35e-160f-4797-8409-285e93c7af7a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111754 Jul 12 13:20:13.608988 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f6e92438-5f5a-478c-83bb-f1ef81940ecb tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:13.609654 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f6e92438-5f5a-478c-83bb-f1ef81940ecb tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:13.610946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 330/662] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:20:12 2022] POST /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments => generated 194 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:20:13.616874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6e92438-5f5a-478c-83bb-f1ef81940ecb tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:13.617309 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6e92438-5f5a-478c-83bb-f1ef81940ecb tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:13.618063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6e92438-5f5a-478c-83bb-f1ef81940ecb tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:13.618598 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f6e92438-5f5a-478c-83bb-f1ef81940ecb tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:13.825791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9c4ab58b-371b-49f4-82e1-40e3425d8e89 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:13.826489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9c4ab58b-371b-49f4-82e1-40e3425d8e89 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:13.834289 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9c4ab58b-371b-49f4-82e1-40e3425d8e89 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:13.835120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9c4ab58b-371b-49f4-82e1-40e3425d8e89 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:13.836039 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9c4ab58b-371b-49f4-82e1-40e3425d8e89 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:13.836318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f6e92438-5f5a-478c-83bb-f1ef81940ecb tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:13.836882 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9c4ab58b-371b-49f4-82e1-40e3425d8e89 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:13.844424 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f6e92438-5f5a-478c-83bb-f1ef81940ecb tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.239826 Jul 12 13:20:13.854700 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 333/663] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:13 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:13.978480 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9c4ab58b-371b-49f4-82e1-40e3425d8e89 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:13.990102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-8487a356-4f16-4437-ab38-6602fc3fbd47 req-6857cc86-d847-4057-b61b-f7329f777f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace38168-9c22-45ee-9115-1dcc8f236117", "tag": "2b671be9-4c90-497b-a3b6-75b9a1ced246"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:13.991692 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9c4ab58b-371b-49f4-82e1-40e3425d8e89 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.170265 Jul 12 13:20:13.992351 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 331/664] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:13 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:14.011022 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8487a356-4f16-4437-ab38-6602fc3fbd47 req-6857cc86-d847-4057-b61b-f7329f777f7b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:14.011793 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8487a356-4f16-4437-ab38-6602fc3fbd47 req-6857cc86-d847-4057-b61b-f7329f777f7b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:14.041051 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-8487a356-4f16-4437-ab38-6602fc3fbd47 req-6857cc86-d847-4057-b61b-f7329f777f7b service nova] Creating event network-changed:2b671be9-4c90-497b-a3b6-75b9a1ced246 for instance ace38168-9c22-45ee-9115-1dcc8f236117 on hv-cinder-79760 Jul 12 13:20:14.058574 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-8487a356-4f16-4437-ab38-6602fc3fbd47 req-6857cc86-d847-4057-b61b-f7329f777f7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074034 Jul 12 13:20:14.059585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 334/665] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:20:14.252584 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7092f801-1f91-4192-ae86-021d79026acb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:14.253670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7092f801-1f91-4192-ae86-021d79026acb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:14.260589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7092f801-1f91-4192-ae86-021d79026acb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:14.261037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7092f801-1f91-4192-ae86-021d79026acb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:14.261812 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7092f801-1f91-4192-ae86-021d79026acb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:14.262240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7092f801-1f91-4192-ae86-021d79026acb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:14.295210 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7092f801-1f91-4192-ae86-021d79026acb tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046723 Jul 12 13:20:14.295828 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 332/666] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:20:14 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:14.862546 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5b42818e-08d4-4740-a5cf-d48452c85688 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:14.863556 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5b42818e-08d4-4740-a5cf-d48452c85688 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:14.870687 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5b42818e-08d4-4740-a5cf-d48452c85688 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:14.871212 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5b42818e-08d4-4740-a5cf-d48452c85688 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:14.871986 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5b42818e-08d4-4740-a5cf-d48452c85688 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:14.872405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5b42818e-08d4-4740-a5cf-d48452c85688 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:15.009176 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-eeda6fcb-01a1-4efd-b514-f598ba4e0357 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:15.009841 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-eeda6fcb-01a1-4efd-b514-f598ba4e0357 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:15.017042 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eeda6fcb-01a1-4efd-b514-f598ba4e0357 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:15.017572 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eeda6fcb-01a1-4efd-b514-f598ba4e0357 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:15.018545 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eeda6fcb-01a1-4efd-b514-f598ba4e0357 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:15.019276 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-eeda6fcb-01a1-4efd-b514-f598ba4e0357 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:15.164968 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-eeda6fcb-01a1-4efd-b514-f598ba4e0357 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:15.165134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5b42818e-08d4-4740-a5cf-d48452c85688 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:15.173037 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5b42818e-08d4-4740-a5cf-d48452c85688 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.314954 Jul 12 13:20:15.173623 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 335/667] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:14 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:15.174746 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-eeda6fcb-01a1-4efd-b514-f598ba4e0357 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.169318 Jul 12 13:20:15.175345 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 333/668] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:15 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:15.310044 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-02823dc5-9482-4dc6-b307-a6c5d326a594 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:15.311694 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-02823dc5-9482-4dc6-b307-a6c5d326a594 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:15.321621 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-02823dc5-9482-4dc6-b307-a6c5d326a594 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:15.322335 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-02823dc5-9482-4dc6-b307-a6c5d326a594 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:15.323645 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-02823dc5-9482-4dc6-b307-a6c5d326a594 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:15.324335 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-02823dc5-9482-4dc6-b307-a6c5d326a594 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:15.355915 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-02823dc5-9482-4dc6-b307-a6c5d326a594 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052191 Jul 12 13:20:15.356379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 336/669] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:20:15 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:20:15.443851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e34e43a8-c77d-46cf-85d1-a2c5f5be8236 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:15.444323 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e34e43a8-c77d-46cf-85d1-a2c5f5be8236 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:15.450759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e34e43a8-c77d-46cf-85d1-a2c5f5be8236 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:15.451226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e34e43a8-c77d-46cf-85d1-a2c5f5be8236 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:15.451974 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e34e43a8-c77d-46cf-85d1-a2c5f5be8236 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:15.452405 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e34e43a8-c77d-46cf-85d1-a2c5f5be8236 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:15.476703 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e34e43a8-c77d-46cf-85d1-a2c5f5be8236 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:20:15.566689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e34e43a8-c77d-46cf-85d1-a2c5f5be8236 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 204 len: 0 microversion: 2.1 time: 0.126664 Jul 12 13:20:15.567303 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 334/670] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:20:15 2022] DELETE /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:20:15.575626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-45a499ea-37e2-47ff-b608-4868710081f4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:15.576219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-45a499ea-37e2-47ff-b608-4868710081f4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:15.582770 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45a499ea-37e2-47ff-b608-4868710081f4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:15.583234 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45a499ea-37e2-47ff-b608-4868710081f4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:15.583977 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45a499ea-37e2-47ff-b608-4868710081f4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:15.584396 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-45a499ea-37e2-47ff-b608-4868710081f4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:15.726725 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-45a499ea-37e2-47ff-b608-4868710081f4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:15.734474 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-45a499ea-37e2-47ff-b608-4868710081f4 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1690 microversion: 2.1 time: 0.162929 Jul 12 13:20:15.735070 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 337/671] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:15 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:16.193671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b9e1264f-493f-414d-b3b6-8ffdb2cb5450 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:16.194254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5482f923-9bc7-46ac-be96-4402ca68debd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:16.194629 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b9e1264f-493f-414d-b3b6-8ffdb2cb5450 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:16.194729 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5482f923-9bc7-46ac-be96-4402ca68debd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:16.201265 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9e1264f-493f-414d-b3b6-8ffdb2cb5450 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:16.201436 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5482f923-9bc7-46ac-be96-4402ca68debd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:16.201679 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9e1264f-493f-414d-b3b6-8ffdb2cb5450 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:16.201818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5482f923-9bc7-46ac-be96-4402ca68debd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:16.202484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9e1264f-493f-414d-b3b6-8ffdb2cb5450 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:16.202642 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5482f923-9bc7-46ac-be96-4402ca68debd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:16.202883 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b9e1264f-493f-414d-b3b6-8ffdb2cb5450 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:16.203081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5482f923-9bc7-46ac-be96-4402ca68debd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:16.353663 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b9e1264f-493f-414d-b3b6-8ffdb2cb5450 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:16.362750 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b9e1264f-493f-414d-b3b6-8ffdb2cb5450 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.173963 Jul 12 13:20:16.363579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 335/672] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:16 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:16.377819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5482f923-9bc7-46ac-be96-4402ca68debd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:16.385820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5482f923-9bc7-46ac-be96-4402ca68debd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.196656 Jul 12 13:20:16.386386 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 338/673] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:16 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:16.756544 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c025a1fb-53b4-4d54-953e-0c6d0c4d7a9d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:16.757536 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c025a1fb-53b4-4d54-953e-0c6d0c4d7a9d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:16.768057 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c025a1fb-53b4-4d54-953e-0c6d0c4d7a9d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:16.768928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c025a1fb-53b4-4d54-953e-0c6d0c4d7a9d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:16.769697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c025a1fb-53b4-4d54-953e-0c6d0c4d7a9d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:16.770126 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c025a1fb-53b4-4d54-953e-0c6d0c4d7a9d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:16.901978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c025a1fb-53b4-4d54-953e-0c6d0c4d7a9d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:16.909605 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c025a1fb-53b4-4d54-953e-0c6d0c4d7a9d tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1690 microversion: 2.1 time: 0.160475 Jul 12 13:20:16.910091 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 336/674] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:16 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:17.379745 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5cfc03b6-c11c-43bd-8929-2309f4cc8c73 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:17.380315 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5cfc03b6-c11c-43bd-8929-2309f4cc8c73 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:17.387263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cfc03b6-c11c-43bd-8929-2309f4cc8c73 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:17.387709 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cfc03b6-c11c-43bd-8929-2309f4cc8c73 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:17.388467 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cfc03b6-c11c-43bd-8929-2309f4cc8c73 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:17.388894 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5cfc03b6-c11c-43bd-8929-2309f4cc8c73 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:17.407965 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c47c3c4f-6b01-43b6-930a-d35bd75a6bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:17.408558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c47c3c4f-6b01-43b6-930a-d35bd75a6bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:17.415652 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c47c3c4f-6b01-43b6-930a-d35bd75a6bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:17.416098 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c47c3c4f-6b01-43b6-930a-d35bd75a6bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:17.417156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c47c3c4f-6b01-43b6-930a-d35bd75a6bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:17.417783 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c47c3c4f-6b01-43b6-930a-d35bd75a6bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:17.521635 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5cfc03b6-c11c-43bd-8929-2309f4cc8c73 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:17.529513 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5cfc03b6-c11c-43bd-8929-2309f4cc8c73 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.153815 Jul 12 13:20:17.530289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 339/675] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:17 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:17.558605 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c47c3c4f-6b01-43b6-930a-d35bd75a6bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:17.571799 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c47c3c4f-6b01-43b6-930a-d35bd75a6bd2 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.167721 Jul 12 13:20:17.572590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 337/676] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:17 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:17.931679 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c4eb4af9-5b14-4f5e-a9a8-dc05fe512061 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:17.932718 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c4eb4af9-5b14-4f5e-a9a8-dc05fe512061 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:17.942376 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c4eb4af9-5b14-4f5e-a9a8-dc05fe512061 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:17.942818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c4eb4af9-5b14-4f5e-a9a8-dc05fe512061 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:17.943603 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c4eb4af9-5b14-4f5e-a9a8-dc05fe512061 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:17.944024 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c4eb4af9-5b14-4f5e-a9a8-dc05fe512061 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:18.082763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c4eb4af9-5b14-4f5e-a9a8-dc05fe512061 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:18.090669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c4eb4af9-5b14-4f5e-a9a8-dc05fe512061 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1690 microversion: 2.1 time: 0.166160 Jul 12 13:20:18.091283 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 340/677] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:17 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:18.550785 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ed168c91-f12b-4a50-a727-63849ceecda9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:18.551708 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ed168c91-f12b-4a50-a727-63849ceecda9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:18.562673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ed168c91-f12b-4a50-a727-63849ceecda9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:18.563458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ed168c91-f12b-4a50-a727-63849ceecda9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:18.564868 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ed168c91-f12b-4a50-a727-63849ceecda9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:18.565476 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ed168c91-f12b-4a50-a727-63849ceecda9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:18.592573 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8b61a57c-cd7c-45f0-b79d-55066d70dc94 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:18.593183 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8b61a57c-cd7c-45f0-b79d-55066d70dc94 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:18.600626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8b61a57c-cd7c-45f0-b79d-55066d70dc94 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:18.601062 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8b61a57c-cd7c-45f0-b79d-55066d70dc94 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:18.601826 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8b61a57c-cd7c-45f0-b79d-55066d70dc94 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:18.602250 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8b61a57c-cd7c-45f0-b79d-55066d70dc94 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:18.695689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ed168c91-f12b-4a50-a727-63849ceecda9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:18.703078 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ed168c91-f12b-4a50-a727-63849ceecda9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.159146 Jul 12 13:20:18.703678 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 338/678] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:18 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:18.736591 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8b61a57c-cd7c-45f0-b79d-55066d70dc94 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:18.744295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8b61a57c-cd7c-45f0-b79d-55066d70dc94 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.155620 Jul 12 13:20:18.744899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 341/679] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:18 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:19.108746 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fc90e2f0-35c3-471f-b922-ce1bd683b6de tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:19.109408 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fc90e2f0-35c3-471f-b922-ce1bd683b6de tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:19.115927 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc90e2f0-35c3-471f-b922-ce1bd683b6de tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:19.116381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc90e2f0-35c3-471f-b922-ce1bd683b6de tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:19.117128 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc90e2f0-35c3-471f-b922-ce1bd683b6de tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:19.117532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fc90e2f0-35c3-471f-b922-ce1bd683b6de tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:19.252113 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fc90e2f0-35c3-471f-b922-ce1bd683b6de tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:19.260546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fc90e2f0-35c3-471f-b922-ce1bd683b6de tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1690 microversion: 2.1 time: 0.155669 Jul 12 13:20:19.261117 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 339/680] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:19 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:19.275078 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-edbaab28-d934-4dce-9b85-655abc7d7b28 req-10759295-8178-40bf-9d63-9d047a2cd02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace38168-9c22-45ee-9115-1dcc8f236117", "name": "network-vif-plugged", "status": "completed", "tag": "2b671be9-4c90-497b-a3b6-75b9a1ced246"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:19.284910 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-edbaab28-d934-4dce-9b85-655abc7d7b28 req-10759295-8178-40bf-9d63-9d047a2cd02b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:19.285578 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-edbaab28-d934-4dce-9b85-655abc7d7b28 req-10759295-8178-40bf-9d63-9d047a2cd02b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:19.297469 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-edbaab28-d934-4dce-9b85-655abc7d7b28 req-10759295-8178-40bf-9d63-9d047a2cd02b service nova] Creating event network-vif-plugged:2b671be9-4c90-497b-a3b6-75b9a1ced246 for instance ace38168-9c22-45ee-9115-1dcc8f236117 on hv-cinder-79760 Jul 12 13:20:19.302992 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-edbaab28-d934-4dce-9b85-655abc7d7b28 req-10759295-8178-40bf-9d63-9d047a2cd02b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031559 Jul 12 13:20:19.303751 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 342/681] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:19.724418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-83b3365f-26dc-42ea-bbc6-b461e5c841f1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:19.725459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-83b3365f-26dc-42ea-bbc6-b461e5c841f1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:19.729202 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:19.737648 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-83b3365f-26dc-42ea-bbc6-b461e5c841f1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:19.738086 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-83b3365f-26dc-42ea-bbc6-b461e5c841f1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:19.738839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-83b3365f-26dc-42ea-bbc6-b461e5c841f1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:19.739269 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-83b3365f-26dc-42ea-bbc6-b461e5c841f1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:19.761937 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-469a25f3-92c4-4667-a5c4-894d95371dbb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:19.762700 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-469a25f3-92c4-4667-a5c4-894d95371dbb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:19.769674 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-469a25f3-92c4-4667-a5c4-894d95371dbb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:19.770365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-469a25f3-92c4-4667-a5c4-894d95371dbb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:19.771205 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-469a25f3-92c4-4667-a5c4-894d95371dbb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:19.771643 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-469a25f3-92c4-4667-a5c4-894d95371dbb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:19.874173 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-83b3365f-26dc-42ea-bbc6-b461e5c841f1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:19.882280 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-83b3365f-26dc-42ea-bbc6-b461e5c841f1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.164780 Jul 12 13:20:19.883062 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 340/682] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:19 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:19.903272 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-469a25f3-92c4-4667-a5c4-894d95371dbb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:19.911189 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-469a25f3-92c4-4667-a5c4-894d95371dbb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.153402 Jul 12 13:20:19.911731 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 343/683] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:19 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:20.277234 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f210a949-5d62-4e03-b2c1-15a146d716f9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:20.277834 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f210a949-5d62-4e03-b2c1-15a146d716f9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:20.284339 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f210a949-5d62-4e03-b2c1-15a146d716f9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:20.284827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f210a949-5d62-4e03-b2c1-15a146d716f9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:20.285525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f210a949-5d62-4e03-b2c1-15a146d716f9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:20.286006 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f210a949-5d62-4e03-b2c1-15a146d716f9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:20.439346 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f210a949-5d62-4e03-b2c1-15a146d716f9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:20.450180 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f210a949-5d62-4e03-b2c1-15a146d716f9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1690 microversion: 2.1 time: 0.176412 Jul 12 13:20:20.451104 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 341/684] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:20 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:20.903719 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bb31b11a-3949-49b9-8919-d55942dd1a44 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:20.906449 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bb31b11a-3949-49b9-8919-d55942dd1a44 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:20.915624 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bb31b11a-3949-49b9-8919-d55942dd1a44 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:20.916045 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bb31b11a-3949-49b9-8919-d55942dd1a44 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:20.917286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bb31b11a-3949-49b9-8919-d55942dd1a44 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:20.917738 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bb31b11a-3949-49b9-8919-d55942dd1a44 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:20.929275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2e0e08f2-1639-4766-b231-e74dcc43450c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:20.929970 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2e0e08f2-1639-4766-b231-e74dcc43450c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:20.938830 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2e0e08f2-1639-4766-b231-e74dcc43450c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:20.939234 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2e0e08f2-1639-4766-b231-e74dcc43450c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:20.940164 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2e0e08f2-1639-4766-b231-e74dcc43450c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:20.940610 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2e0e08f2-1639-4766-b231-e74dcc43450c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:21.192017 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bb31b11a-3949-49b9-8919-d55942dd1a44 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:21.203225 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bb31b11a-3949-49b9-8919-d55942dd1a44 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.305674 Jul 12 13:20:21.203791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 344/685] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:20 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:21.306715 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08154c6e-d7be-4e1a-885d-2dfb300af6d8"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:21.308091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:21.316589 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:21.317325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:21.318364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:21.318935 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:21.406818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Invalid volume: volume 08154c6e-d7be-4e1a-885d-2dfb300af6d8 is already attached to instances: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: POST /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments HTTP/1.1 Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 74 Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:20:21.409247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {"volumeAttachment": {"volumeId": "08154c6e-d7be-4e1a-885d-2dfb300af6d8"}} Jul 12 13:20:21.410837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Invalid volume: volume 08154c6e-d7be-4e1a-885d-2dfb300af6d8 is already attached to instances: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'server_id': '4a9dca1a-25b5-4890-9c3a-33514d11fdd3', 'body': {'volumeAttachment': {'volumeId': '08154c6e-d7be-4e1a-885d-2dfb300af6d8'}}} Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 08154c6e-d7be-4e1a-885d-2dfb300af6d8 is already attached to instances: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:21.411860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 08154c6e-d7be-4e1a-885d-2dfb300af6d8 is already attached to instances: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:21.413319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:21.414685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:21.414685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:21.414685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:21.414685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 08154c6e-d7be-4e1a-885d-2dfb300af6d8 is already attached to instances: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 Jul 12 13:20:21.414685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:21.415112 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2e0e08f2-1639-4766-b231-e74dcc43450c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:21.416298 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 400 to user: Invalid volume: volume 08154c6e-d7be-4e1a-885d-2dfb300af6d8 is already attached to instances: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:21.418524 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c34651be-461a-4552-a1a3-2ed2888f4740 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115798 Jul 12 13:20:21.419251 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 345/686] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:20:21 2022] POST /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:20:21.422644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2e0e08f2-1639-4766-b231-e74dcc43450c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.495631 Jul 12 13:20:21.422644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 342/687] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:20 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:21.471616 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-35328a65-e864-4e17-8020-ece8c4d9c66a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:21.472358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-35328a65-e864-4e17-8020-ece8c4d9c66a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:21.478706 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-35328a65-e864-4e17-8020-ece8c4d9c66a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:21.479514 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-35328a65-e864-4e17-8020-ece8c4d9c66a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:21.480282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-35328a65-e864-4e17-8020-ece8c4d9c66a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:21.480909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-35328a65-e864-4e17-8020-ece8c4d9c66a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:21.482445 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4e1a3f04-f7e4-4612-aebc-83c3d44ccf8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:21.482931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4e1a3f04-f7e4-4612-aebc-83c3d44ccf8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:21.489116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4e1a3f04-f7e4-4612-aebc-83c3d44ccf8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:21.489552 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4e1a3f04-f7e4-4612-aebc-83c3d44ccf8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:21.490265 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4e1a3f04-f7e4-4612-aebc-83c3d44ccf8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:21.490882 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4e1a3f04-f7e4-4612-aebc-83c3d44ccf8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:21.512146 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:21.586548 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-4e1a3f04-f7e4-4612-aebc-83c3d44ccf8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lazy-loading 'services' on Instance uuid 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:20:21.661828 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-35328a65-e864-4e17-8020-ece8c4d9c66a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:21.664064 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4e1a3f04-f7e4-4612-aebc-83c3d44ccf8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments/08154c6e-d7be-4e1a-885d-2dfb300af6d8" status: 202 len: 0 microversion: 2.1 time: 0.185216 Jul 12 13:20:21.665114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 346/688] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:20:21 2022] DELETE /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments/08154c6e-d7be-4e1a-885d-2dfb300af6d8 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:20:21.671635 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-35328a65-e864-4e17-8020-ece8c4d9c66a tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1690 microversion: 2.1 time: 0.204605 Jul 12 13:20:21.672342 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 343/689] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:21 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1690 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:21.674289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-674d9bf0-a37e-49eb-85bb-fe162c4f94fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:21.675445 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-674d9bf0-a37e-49eb-85bb-fe162c4f94fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:21.682317 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-674d9bf0-a37e-49eb-85bb-fe162c4f94fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:21.682791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-674d9bf0-a37e-49eb-85bb-fe162c4f94fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:21.683666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-674d9bf0-a37e-49eb-85bb-fe162c4f94fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:21.684096 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-674d9bf0-a37e-49eb-85bb-fe162c4f94fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:21.713286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-674d9bf0-a37e-49eb-85bb-fe162c4f94fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Jul 12 13:20:21.713756 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 347/690] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:20:21 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:20:22.185627 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-b6246d11-0d06-4830-b6db-1b8675c3ed3d req-f12e4aad-aa45-4e82-8f60-0940e1e67441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7df43b-4b7b-46af-ad37-d0267407bff2", "name": "network-vif-deleted", "tag": "2a046eef-1dcf-44d2-be29-2ae216e4b855"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:22.194700 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-b6246d11-0d06-4830-b6db-1b8675c3ed3d req-f12e4aad-aa45-4e82-8f60-0940e1e67441 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:22.195157 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-b6246d11-0d06-4830-b6db-1b8675c3ed3d req-f12e4aad-aa45-4e82-8f60-0940e1e67441 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:22.207032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-b6246d11-0d06-4830-b6db-1b8675c3ed3d req-f12e4aad-aa45-4e82-8f60-0940e1e67441 service nova] Creating event network-vif-deleted:2a046eef-1dcf-44d2-be29-2ae216e4b855 for instance bd7df43b-4b7b-46af-ad37-d0267407bff2 on hv-cinder-79760 Jul 12 13:20:22.212009 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-b6246d11-0d06-4830-b6db-1b8675c3ed3d req-f12e4aad-aa45-4e82-8f60-0940e1e67441 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029998 Jul 12 13:20:22.212914 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 344/691] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:22.223312 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7d7681dc-ebed-4706-b23e-b66100d33fa9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:22.224648 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7d7681dc-ebed-4706-b23e-b66100d33fa9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:22.235035 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d7681dc-ebed-4706-b23e-b66100d33fa9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:22.235485 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d7681dc-ebed-4706-b23e-b66100d33fa9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:22.236447 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d7681dc-ebed-4706-b23e-b66100d33fa9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:22.237111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d7681dc-ebed-4706-b23e-b66100d33fa9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:22.378561 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7d7681dc-ebed-4706-b23e-b66100d33fa9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:22.388488 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7d7681dc-ebed-4706-b23e-b66100d33fa9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1358 microversion: 2.1 time: 0.169224 Jul 12 13:20:22.389173 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 348/692] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:22 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:22.438382 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6f8cbd0e-1051-4613-99cc-ad08159841c8 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:22.439828 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6f8cbd0e-1051-4613-99cc-ad08159841c8 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:22.446602 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6f8cbd0e-1051-4613-99cc-ad08159841c8 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:22.447168 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6f8cbd0e-1051-4613-99cc-ad08159841c8 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:22.447998 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6f8cbd0e-1051-4613-99cc-ad08159841c8 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:22.448479 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6f8cbd0e-1051-4613-99cc-ad08159841c8 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:22.583225 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6f8cbd0e-1051-4613-99cc-ad08159841c8 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:22.592403 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6f8cbd0e-1051-4613-99cc-ad08159841c8 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.158229 Jul 12 13:20:22.593038 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 345/693] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:22 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:22.689435 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-83537477-ed0c-4b4b-94d9-98c29839f0d5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:22.690294 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-83537477-ed0c-4b4b-94d9-98c29839f0d5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:22.697675 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-83537477-ed0c-4b4b-94d9-98c29839f0d5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:22.698110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-83537477-ed0c-4b4b-94d9-98c29839f0d5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:22.699069 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-83537477-ed0c-4b4b-94d9-98c29839f0d5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:22.699489 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-83537477-ed0c-4b4b-94d9-98c29839f0d5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:22.725689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-05574765-5140-463d-b031-2fd1d9816e8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:22.727085 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-05574765-5140-463d-b031-2fd1d9816e8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:22.733975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-05574765-5140-463d-b031-2fd1d9816e8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:22.734420 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-05574765-5140-463d-b031-2fd1d9816e8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:22.735233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-05574765-5140-463d-b031-2fd1d9816e8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:22.735664 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-05574765-5140-463d-b031-2fd1d9816e8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:22.740181 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:22.769086 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-05574765-5140-463d-b031-2fd1d9816e8e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047998 Jul 12 13:20:22.770144 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 346/694] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:20:22 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:22.772111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-83537477-ed0c-4b4b-94d9-98c29839f0d5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:22.780930 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-83537477-ed0c-4b4b-94d9-98c29839f0d5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1330 microversion: 2.1 time: 0.095736 Jul 12 13:20:22.781519 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 349/695] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:22 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:23.408405 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-72b68ce3-2872-42cb-9ad9-174ab3b02adc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:23.409778 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-72b68ce3-2872-42cb-9ad9-174ab3b02adc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:23.421498 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-72b68ce3-2872-42cb-9ad9-174ab3b02adc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.422317 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-72b68ce3-2872-42cb-9ad9-174ab3b02adc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.423565 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-72b68ce3-2872-42cb-9ad9-174ab3b02adc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.424319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-72b68ce3-2872-42cb-9ad9-174ab3b02adc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.568003 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-72b68ce3-2872-42cb-9ad9-174ab3b02adc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:23.579049 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-72b68ce3-2872-42cb-9ad9-174ab3b02adc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1548 microversion: 2.1 time: 0.176644 Jul 12 13:20:23.579851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 347/696] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:23 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:23.595905 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a94f0f16-80ca-42b0-b806-00ff42d62423 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:23.596517 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a94f0f16-80ca-42b0-b806-00ff42d62423 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:23.603652 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a94f0f16-80ca-42b0-b806-00ff42d62423 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.604080 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a94f0f16-80ca-42b0-b806-00ff42d62423 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.604940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a94f0f16-80ca-42b0-b806-00ff42d62423 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.605371 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a94f0f16-80ca-42b0-b806-00ff42d62423 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.610637 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6b0b1d4e-3f11-4ae0-8e44-83d9dbc6bffb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:23.611265 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6b0b1d4e-3f11-4ae0-8e44-83d9dbc6bffb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:23.620320 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b0b1d4e-3f11-4ae0-8e44-83d9dbc6bffb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.620761 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b0b1d4e-3f11-4ae0-8e44-83d9dbc6bffb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.621526 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b0b1d4e-3f11-4ae0-8e44-83d9dbc6bffb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.621948 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b0b1d4e-3f11-4ae0-8e44-83d9dbc6bffb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.740935 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a94f0f16-80ca-42b0-b806-00ff42d62423 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:23.749862 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a94f0f16-80ca-42b0-b806-00ff42d62423 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1548 microversion: 2.1 time: 0.157773 Jul 12 13:20:23.750521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 350/697] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:23 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:23.765901 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6fe5aa4d-8dfd-4ccb-b8f7-f4fa204db5c8 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:23.770240 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-6fe5aa4d-8dfd-4ccb-b8f7-f4fa204db5c8 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:23.770899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6fe5aa4d-8dfd-4ccb-b8f7-f4fa204db5c8 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Searching by: {'deleted': False, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24'} {{(pid=117963) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 13:20:23.772946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6b0b1d4e-3f11-4ae0-8e44-83d9dbc6bffb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:23.778139 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa4d-8dfd-4ccb-b8f7-f4fa204db5c8 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.778583 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa4d-8dfd-4ccb-b8f7-f4fa204db5c8 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.779404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa4d-8dfd-4ccb-b8f7-f4fa204db5c8 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.779830 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa4d-8dfd-4ccb-b8f7-f4fa204db5c8 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.781278 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6b0b1d4e-3f11-4ae0-8e44-83d9dbc6bffb tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.175084 Jul 12 13:20:23.781834 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 348/698] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:23 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:23.786544 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fbfe5bc3-d3dc-4d61-b027-3df47c4a9d80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:23.787551 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fbfe5bc3-d3dc-4d61-b027-3df47c4a9d80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:23.793926 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fbfe5bc3-d3dc-4d61-b027-3df47c4a9d80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.794361 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fbfe5bc3-d3dc-4d61-b027-3df47c4a9d80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.795133 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fbfe5bc3-d3dc-4d61-b027-3df47c4a9d80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.795558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fbfe5bc3-d3dc-4d61-b027-3df47c4a9d80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.825764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fbfe5bc3-d3dc-4d61-b027-3df47c4a9d80 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 Jul 12 13:20:23.826320 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 349/699] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:20:23 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:23.830764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:23.831382 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:23.837208 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.837641 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.838403 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.838825 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.869210 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.869640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.870074 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lazy-loading 'fault' on Instance uuid bd7df43b-4b7b-46af-ad37-d0267407bff2 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:20:23.874244 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.multi_cell_list [None req-6fe5aa4d-8dfd-4ccb-b8f7-f4fa204db5c8 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117963) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 13:20:23.911258 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:23.919032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ccfa341d-51c0-4cdf-b817-39c49d7c8bca tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 200 len: 1335 microversion: 2.1 time: 0.091765 Jul 12 13:20:23.919597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 350/700] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:23 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 1335 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:23.970859 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6fe5aa4d-8dfd-4ccb-b8f7-f4fa204db5c8 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208577 Jul 12 13:20:23.971499 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 351/701] 10.222.0.33 () {58 vars in 1124 bytes} [Tue Jul 12 13:20:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:23.982405 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e742596b-a187-4b85-8522-0a090de0fcdd tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:23.983231 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e742596b-a187-4b85-8522-0a090de0fcdd tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:23.990074 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e742596b-a187-4b85-8522-0a090de0fcdd tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.990579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e742596b-a187-4b85-8522-0a090de0fcdd tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:23.991632 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e742596b-a187-4b85-8522-0a090de0fcdd tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:23.992013 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e742596b-a187-4b85-8522-0a090de0fcdd tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:24.133819 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e742596b-a187-4b85-8522-0a090de0fcdd tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:24.141878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e742596b-a187-4b85-8522-0a090de0fcdd tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1548 microversion: 2.1 time: 0.163682 Jul 12 13:20:24.142497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 351/702] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:23 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:24.802935 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1e53fd6f-a292-40f2-b436-72e05cb863ab tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:24.804028 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1e53fd6f-a292-40f2-b436-72e05cb863ab tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:24.814377 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e53fd6f-a292-40f2-b436-72e05cb863ab tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:24.815446 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e53fd6f-a292-40f2-b436-72e05cb863ab tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:24.816194 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e53fd6f-a292-40f2-b436-72e05cb863ab tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:24.816623 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1e53fd6f-a292-40f2-b436-72e05cb863ab tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:24.837858 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-08ff0210-90a5-491d-ab0a-dd1a8ed30866 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:24.838844 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-08ff0210-90a5-491d-ab0a-dd1a8ed30866 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:24.845509 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-08ff0210-90a5-491d-ab0a-dd1a8ed30866 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:24.845933 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-08ff0210-90a5-491d-ab0a-dd1a8ed30866 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:24.846750 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-08ff0210-90a5-491d-ab0a-dd1a8ed30866 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:24.847174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-08ff0210-90a5-491d-ab0a-dd1a8ed30866 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:24.876996 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-08ff0210-90a5-491d-ab0a-dd1a8ed30866 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043200 Jul 12 13:20:24.877883 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 352/703] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:20:24 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:20:24.936816 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:24.937455 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: bd7df43b-4b7b-46af-ad37-d0267407bff2] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:24.944139 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:24.944573 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:24.945334 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:24.945757 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:24.961009 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] HTTP exception thrown: Instance bd7df43b-4b7b-46af-ad37-d0267407bff2 could not be found. Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Request method failure captured: Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 HTTP/1.1 Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPflp1o9WogLAsdDvmSYbq3haIRqeuf6GL6xU3vqmbsanSflHqREzYieLzIoopLz13Y8ZWtiAhuSzGa5XP_uWH_z5C9p8hYLodvCvW6njxHN9XLwyQv63XoytrSUUxgC1j1Sx9JqPFo9z2KdVjTsbxxebQxUx3vj0rtsuddM65GxVY Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: d175790280c1443192810e2b789b9926 Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:20:24.963125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d175790280c1443192810e2b789b9926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d175790280c1443192810e2b789b9926"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: d175790280c1443192810e2b789b9926 Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 9e08af1e7f794f85b57d6912db529577 Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance bd7df43b-4b7b-46af-ad37-d0267407bff2 could not be found. Jul 12 13:20:24.964502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': 'bd7df43b-4b7b-46af-ad37-d0267407bff2'} Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7df43b-4b7b-46af-ad37-d0267407bff2 could not be found. Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:24.965263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7df43b-4b7b-46af-ad37-d0267407bff2 could not be found. Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7df43b-4b7b-46af-ad37-d0267407bff2 could not be found. Jul 12 13:20:24.966449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:24.967592 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Returning 404 to user: Instance bd7df43b-4b7b-46af-ad37-d0267407bff2 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:24.967592 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-206f2933-df7f-4af9-a8fb-070257c42e7e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2" status: 404 len: 111 microversion: 2.1 time: 0.032222 Jul 12 13:20:24.967592 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 353/704] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:24 2022] GET /compute/v2.1/servers/bd7df43b-4b7b-46af-ad37-d0267407bff2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:20:24.974143 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-81fa0a57-5122-4ead-a9f7-527b91112573 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:24.974633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-81fa0a57-5122-4ead-a9f7-527b91112573 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:24.983150 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-81fa0a57-5122-4ead-a9f7-527b91112573 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:24.983588 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-81fa0a57-5122-4ead-a9f7-527b91112573 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:24.984377 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-81fa0a57-5122-4ead-a9f7-527b91112573 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:24.984797 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-81fa0a57-5122-4ead-a9f7-527b91112573 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:25.011989 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-81fa0a57-5122-4ead-a9f7-527b91112573 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:20:25.107921 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-81fa0a57-5122-4ead-a9f7-527b91112573 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 204 len: 0 microversion: 2.1 time: 0.137999 Jul 12 13:20:25.109263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 354/705] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:20:24 2022] DELETE /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:20:25.116463 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f14c3a72-a459-4cf7-a067-bd0577b0d122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '.version_select at 0x7fd48d198940>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:25.141533 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f14c3a72-a459-4cf7-a067-bd0577b0d122 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037036041" status: 202 len: 0 microversion: 2.1 time: 0.030555 Jul 12 13:20:25.142570 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 355/706] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 12 13:20:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037036041 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:20:25.151401 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a0694c65-0cfe-4256-8c75-6adf1faddc9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:25.152437 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a0694c65-0cfe-4256-8c75-6adf1faddc9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:25.163159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a0694c65-0cfe-4256-8c75-6adf1faddc9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:25.163758 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a0694c65-0cfe-4256-8c75-6adf1faddc9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:25.164607 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a0694c65-0cfe-4256-8c75-6adf1faddc9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:25.165160 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a0694c65-0cfe-4256-8c75-6adf1faddc9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:25.236804 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1e53fd6f-a292-40f2-b436-72e05cb863ab tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:25.246636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1e53fd6f-a292-40f2-b436-72e05cb863ab tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.450552 Jul 12 13:20:25.256035 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 352/707] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:24 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:25.310998 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a0694c65-0cfe-4256-8c75-6adf1faddc9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:25.322591 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a0694c65-0cfe-4256-8c75-6adf1faddc9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1679 microversion: 2.1 time: 0.178832 Jul 12 13:20:25.323541 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 356/708] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:25 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:25.689388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-969df681-f114-4b8f-8b7a-504a0ca72efc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:25.690713 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-969df681-f114-4b8f-8b7a-504a0ca72efc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:25.697813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-969df681-f114-4b8f-8b7a-504a0ca72efc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:25.698339 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-969df681-f114-4b8f-8b7a-504a0ca72efc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:25.699142 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-969df681-f114-4b8f-8b7a-504a0ca72efc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:25.699573 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-969df681-f114-4b8f-8b7a-504a0ca72efc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:26.265521 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-42973c27-aa19-4329-b39e-babba50f6528 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:26.266146 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-42973c27-aa19-4329-b39e-babba50f6528 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:26.273638 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42973c27-aa19-4329-b39e-babba50f6528 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:26.274081 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42973c27-aa19-4329-b39e-babba50f6528 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:26.274832 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42973c27-aa19-4329-b39e-babba50f6528 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:26.275287 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42973c27-aa19-4329-b39e-babba50f6528 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:26.418891 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-42973c27-aa19-4329-b39e-babba50f6528 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:26.430304 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-42973c27-aa19-4329-b39e-babba50f6528 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.168898 Jul 12 13:20:26.430851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 357/709] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:26 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:26.435393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c6c61675-24c3-4e56-a1ad-95704ef0a0bc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:26.435997 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c6c61675-24c3-4e56-a1ad-95704ef0a0bc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:26.442008 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c6c61675-24c3-4e56-a1ad-95704ef0a0bc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:26.442454 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c6c61675-24c3-4e56-a1ad-95704ef0a0bc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:26.443779 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c6c61675-24c3-4e56-a1ad-95704ef0a0bc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:26.444207 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c6c61675-24c3-4e56-a1ad-95704ef0a0bc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:26.589039 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c6c61675-24c3-4e56-a1ad-95704ef0a0bc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:26.597359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c6c61675-24c3-4e56-a1ad-95704ef0a0bc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1679 microversion: 2.1 time: 0.165447 Jul 12 13:20:26.597970 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 358/710] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:26 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:26.695385 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-969df681-f114-4b8f-8b7a-504a0ca72efc tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "POST /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.009930 Jul 12 13:20:26.696861 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 353/711] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:20:25 2022] POST /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments => generated 194 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:27.446839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3db8d457-7ae0-44f1-ad5d-9c08e5bcacd6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:27.447439 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3db8d457-7ae0-44f1-ad5d-9c08e5bcacd6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:27.453794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3db8d457-7ae0-44f1-ad5d-9c08e5bcacd6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:27.454249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3db8d457-7ae0-44f1-ad5d-9c08e5bcacd6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:27.455010 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3db8d457-7ae0-44f1-ad5d-9c08e5bcacd6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:27.455464 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3db8d457-7ae0-44f1-ad5d-9c08e5bcacd6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:27.600869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3db8d457-7ae0-44f1-ad5d-9c08e5bcacd6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:27.609522 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3db8d457-7ae0-44f1-ad5d-9c08e5bcacd6 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.166704 Jul 12 13:20:27.610500 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 359/712] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:27 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:27.617318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e68edec3-f679-4647-aa36-896c139d6b25 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:27.618289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e68edec3-f679-4647-aa36-896c139d6b25 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:27.626383 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e68edec3-f679-4647-aa36-896c139d6b25 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:27.626873 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e68edec3-f679-4647-aa36-896c139d6b25 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:27.627628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e68edec3-f679-4647-aa36-896c139d6b25 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:27.628193 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e68edec3-f679-4647-aa36-896c139d6b25 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:27.705025 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e68edec3-f679-4647-aa36-896c139d6b25 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:27.712726 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e68edec3-f679-4647-aa36-896c139d6b25 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1612 microversion: 2.1 time: 0.099934 Jul 12 13:20:27.713292 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 354/713] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:27 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1612 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:27.802042 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-2d2edfc3-014c-4ec2-b654-cc3fab41a589 req-a2145e6b-907b-4c32-ae82-38a672a0ce5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9dca1a-25b5-4890-9c3a-33514d11fdd3", "name": "network-vif-deleted", "tag": "6a9fdbcc-bc90-4cdd-9813-84987de6cb7e"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:27.810308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-2d2edfc3-014c-4ec2-b654-cc3fab41a589 req-a2145e6b-907b-4c32-ae82-38a672a0ce5c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:27.810743 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-2d2edfc3-014c-4ec2-b654-cc3fab41a589 req-a2145e6b-907b-4c32-ae82-38a672a0ce5c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:27.825290 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-2d2edfc3-014c-4ec2-b654-cc3fab41a589 req-a2145e6b-907b-4c32-ae82-38a672a0ce5c service nova] Creating event network-vif-deleted:6a9fdbcc-bc90-4cdd-9813-84987de6cb7e for instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 on hv-cinder-79760 Jul 12 13:20:27.845456 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-2d2edfc3-014c-4ec2-b654-cc3fab41a589 req-a2145e6b-907b-4c32-ae82-38a672a0ce5c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044494 Jul 12 13:20:27.846369 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 360/714] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:28.074834 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-46169ff2-8bc9-4823-90e8-6340c96819ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:28.075359 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-46169ff2-8bc9-4823-90e8-6340c96819ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:28.082096 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46169ff2-8bc9-4823-90e8-6340c96819ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:28.082644 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46169ff2-8bc9-4823-90e8-6340c96819ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:28.083650 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46169ff2-8bc9-4823-90e8-6340c96819ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:28.083917 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46169ff2-8bc9-4823-90e8-6340c96819ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:28.110819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-46169ff2-8bc9-4823-90e8-6340c96819ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:20:28.196013 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-46169ff2-8bc9-4823-90e8-6340c96819ce tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "DELETE /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 204 len: 0 microversion: 2.1 time: 0.124786 Jul 12 13:20:28.196569 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 355/715] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:20:28 2022] DELETE /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:20:28.206158 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f1e448b7-fdd6-4b42-b73e-69e98e8ab416 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:28.207157 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f1e448b7-fdd6-4b42-b73e-69e98e8ab416 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:28.214821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1e448b7-fdd6-4b42-b73e-69e98e8ab416 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:28.215491 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1e448b7-fdd6-4b42-b73e-69e98e8ab416 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:28.216432 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1e448b7-fdd6-4b42-b73e-69e98e8ab416 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:28.216866 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f1e448b7-fdd6-4b42-b73e-69e98e8ab416 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:28.362272 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f1e448b7-fdd6-4b42-b73e-69e98e8ab416 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:28.371419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f1e448b7-fdd6-4b42-b73e-69e98e8ab416 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1506 microversion: 2.1 time: 0.170140 Jul 12 13:20:28.372014 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 361/716] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:28 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:28.628251 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a5375ff4-0117-44db-b96b-41061eb216d1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:28.629064 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a5375ff4-0117-44db-b96b-41061eb216d1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:28.636007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5375ff4-0117-44db-b96b-41061eb216d1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:28.636451 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5375ff4-0117-44db-b96b-41061eb216d1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:28.637208 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5375ff4-0117-44db-b96b-41061eb216d1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:28.637630 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5375ff4-0117-44db-b96b-41061eb216d1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:28.729817 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:28.730412 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:28.737951 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:28.738546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:28.739572 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:28.740105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:28.773686 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:28.774124 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:28.774573 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lazy-loading 'fault' on Instance uuid 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:20:28.782822 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a5375ff4-0117-44db-b96b-41061eb216d1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:28.791572 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a5375ff4-0117-44db-b96b-41061eb216d1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.167365 Jul 12 13:20:28.792994 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 356/717] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:28 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:28.815404 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:28.817698 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:28.824644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e5bd1e3d-263f-4288-adbe-0693d0908bd9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1331 microversion: 2.1 time: 0.098708 Jul 12 13:20:28.825249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 362/718] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:28 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:29.390911 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-da59d75c-f169-43f6-b610-dba9823b0c7c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:29.391792 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-da59d75c-f169-43f6-b610-dba9823b0c7c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:29.394915 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:29.403345 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da59d75c-f169-43f6-b610-dba9823b0c7c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:29.403930 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da59d75c-f169-43f6-b610-dba9823b0c7c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:29.404968 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da59d75c-f169-43f6-b610-dba9823b0c7c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:29.405583 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-da59d75c-f169-43f6-b610-dba9823b0c7c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:29.544367 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-da59d75c-f169-43f6-b610-dba9823b0c7c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:29.552218 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-da59d75c-f169-43f6-b610-dba9823b0c7c tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1506 microversion: 2.1 time: 0.166634 Jul 12 13:20:29.552772 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 357/719] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:29 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:29.813244 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-709cd5af-be6e-4983-9068-a06370aa3cd1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:29.814057 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-709cd5af-be6e-4983-9068-a06370aa3cd1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:29.827751 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-709cd5af-be6e-4983-9068-a06370aa3cd1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:29.828536 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-709cd5af-be6e-4983-9068-a06370aa3cd1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:29.829766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-709cd5af-be6e-4983-9068-a06370aa3cd1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:29.830477 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-709cd5af-be6e-4983-9068-a06370aa3cd1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:29.841704 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:29.842311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:29.848518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:29.848968 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:29.849724 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:29.850361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:29.881468 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:29.882114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:29.882414 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lazy-loading 'fault' on Instance uuid 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:20:29.925195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:29.929331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:29.934121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dcbe7880-3364-4bf7-b151-b8982ad20294 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 200 len: 1331 microversion: 2.1 time: 0.096295 Jul 12 13:20:29.935034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 358/720] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:29 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:29.979393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-709cd5af-be6e-4983-9068-a06370aa3cd1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:29.987275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-709cd5af-be6e-4983-9068-a06370aa3cd1 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.180568 Jul 12 13:20:29.987827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 363/721] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:29 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:30.573697 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ad83f74d-d27d-47e0-ab43-a85639622b50 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:30.574461 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ad83f74d-d27d-47e0-ab43-a85639622b50 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:30.585561 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ad83f74d-d27d-47e0-ab43-a85639622b50 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:30.585992 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ad83f74d-d27d-47e0-ab43-a85639622b50 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:30.586741 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ad83f74d-d27d-47e0-ab43-a85639622b50 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:30.587199 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ad83f74d-d27d-47e0-ab43-a85639622b50 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:30.741082 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ad83f74d-d27d-47e0-ab43-a85639622b50 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:30.748941 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ad83f74d-d27d-47e0-ab43-a85639622b50 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1506 microversion: 2.1 time: 0.182156 Jul 12 13:20:30.749526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 359/722] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:30 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:30.951008 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:30.951761 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:30.962370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:30.962817 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:30.964388 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:30.964839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:30.980180 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 HTTP/1.1 Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:20:30.981928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:20:30.983542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '4a9dca1a-25b5-4890-9c3a-33514d11fdd3'} Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:30.984406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:20:30.985774 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:30.987734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:30.988616 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4eb063f2-605a-43a5-a345-f22d34e7a1c0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 404 len: 111 microversion: 2.1 time: 0.041529 Jul 12 13:20:30.989136 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 364/723] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:30 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:20:30.999056 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-77387a22-bfbf-4c13-ad19-4f6ea99a1d29 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '.version_select at 0x7fd48cec84c0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:31.005506 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-55a41d38-14d3-45a5-afcb-7625f620f3b5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:31.006125 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-55a41d38-14d3-45a5-afcb-7625f620f3b5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:31.012751 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-55a41d38-14d3-45a5-afcb-7625f620f3b5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:31.013404 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-55a41d38-14d3-45a5-afcb-7625f620f3b5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:31.014344 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-55a41d38-14d3-45a5-afcb-7625f620f3b5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:31.015084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-55a41d38-14d3-45a5-afcb-7625f620f3b5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:31.030126 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-77387a22-bfbf-4c13-ad19-4f6ea99a1d29 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231534623" status: 202 len: 0 microversion: 2.1 time: 0.036169 Jul 12 13:20:31.031043 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 360/724] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 12 13:20:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231534623 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:20:31.216217 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-55a41d38-14d3-45a5-afcb-7625f620f3b5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:31.231260 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-55a41d38-14d3-45a5-afcb-7625f620f3b5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.230816 Jul 12 13:20:31.231982 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 365/725] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:30 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:31.635522 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-e06ffa7b-5b33-4a40-b794-d45ca6dd3161 req-10c83991-fb1e-4c76-b8f9-02fd6c44fa2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882374fe-d7b8-4a2b-a70c-e7d15c9138c1", "name": "network-vif-deleted", "tag": "d389aa10-6727-4171-84ec-b212c85b7728"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:31.645803 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-e06ffa7b-5b33-4a40-b794-d45ca6dd3161 req-10c83991-fb1e-4c76-b8f9-02fd6c44fa2b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:31.646601 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-e06ffa7b-5b33-4a40-b794-d45ca6dd3161 req-10c83991-fb1e-4c76-b8f9-02fd6c44fa2b service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:31.659009 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-e06ffa7b-5b33-4a40-b794-d45ca6dd3161 req-10c83991-fb1e-4c76-b8f9-02fd6c44fa2b service nova] Creating event network-vif-deleted:d389aa10-6727-4171-84ec-b212c85b7728 for instance 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 on hv-cinder-79760 Jul 12 13:20:31.664626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-e06ffa7b-5b33-4a40-b794-d45ca6dd3161 req-10c83991-fb1e-4c76-b8f9-02fd6c44fa2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033469 Jul 12 13:20:31.666173 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 361/726] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:31.766707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-eea44e6e-c7ce-45f6-8a31-9a0a4cd02eef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: .version_select at 0x7fd48cfa3160>, body: {"keypair": {"name": "tempest-keypair-1113206513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6DhU9eeD0mblX+JhDsk+OAtftEYXmem5w3CAtmICrVU17woHjqABV4shWk/FqTpCFhcT16WYoS+JI9Yag66buhr/LVDYfPsYP3s4eZoRW+ydGvdvHYlGfWPXiCNNu4rw=="}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:31.767548 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-82b8a869-99da-484a-a536-e4561e6b4eb9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:31.768339 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-82b8a869-99da-484a-a536-e4561e6b4eb9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:31.775295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82b8a869-99da-484a-a536-e4561e6b4eb9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:31.775809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82b8a869-99da-484a-a536-e4561e6b4eb9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:31.776629 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82b8a869-99da-484a-a536-e4561e6b4eb9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:31.777119 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-82b8a869-99da-484a-a536-e4561e6b4eb9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:31.780993 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-eea44e6e-c7ce-45f6-8a31-9a0a4cd02eef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:20:31.785653 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-eea44e6e-c7ce-45f6-8a31-9a0a4cd02eef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for user c8380cfce8114b609c8f0cbf9d445049 and project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'key_pairs'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:20:31.808402 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-eea44e6e-c7ce-45f6-8a31-9a0a4cd02eef tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045614 Jul 12 13:20:31.808897 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 366/727] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:20:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:31.841741 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-82b8a869-99da-484a-a536-e4561e6b4eb9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:31.849141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-82b8a869-99da-484a-a536-e4561e6b4eb9 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1291 microversion: 2.1 time: 0.086333 Jul 12 13:20:31.849716 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 362/728] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:31 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1291 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:32.249222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d08e41df-7599-4bda-aa85-e783d3860295 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:32.250045 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d08e41df-7599-4bda-aa85-e783d3860295 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:32.256466 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d08e41df-7599-4bda-aa85-e783d3860295 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:32.257118 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d08e41df-7599-4bda-aa85-e783d3860295 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:32.257914 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d08e41df-7599-4bda-aa85-e783d3860295 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:32.258371 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d08e41df-7599-4bda-aa85-e783d3860295 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:32.392338 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d08e41df-7599-4bda-aa85-e783d3860295 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:32.401954 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d08e41df-7599-4bda-aa85-e783d3860295 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.157315 Jul 12 13:20:32.402525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 367/729] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:32 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:32.867131 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d9e02c85-892c-475d-b310-9bb36c8d2ed2 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:32.868594 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d9e02c85-892c-475d-b310-9bb36c8d2ed2 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:32.876073 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9e02c85-892c-475d-b310-9bb36c8d2ed2 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:32.876532 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9e02c85-892c-475d-b310-9bb36c8d2ed2 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:32.877301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9e02c85-892c-475d-b310-9bb36c8d2ed2 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:32.877747 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9e02c85-892c-475d-b310-9bb36c8d2ed2 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:32.953176 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d9e02c85-892c-475d-b310-9bb36c8d2ed2 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:32.961028 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d9e02c85-892c-475d-b310-9bb36c8d2ed2 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1291 microversion: 2.1 time: 0.098853 Jul 12 13:20:32.961600 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 363/730] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:32 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1291 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:33.120360 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1365233924", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5765647a-f52d-4fde-ab6b-47dcfe530ab0"}], "security_groups": [{"name": "tempest-securitygroup--1816141374"}], "key_name": "tempest-keypair-1113206513", "user_data": "}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:33.225211 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] validate_networks() for [('5765647a-f52d-4fde-ab6b-47dcfe530ab0', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:20:33.420419 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0d3ea48e-5e3e-407e-a855-2c992290a5f5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:33.421019 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0d3ea48e-5e3e-407e-a855-2c992290a5f5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:33.427655 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0d3ea48e-5e3e-407e-a855-2c992290a5f5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:33.428323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0d3ea48e-5e3e-407e-a855-2c992290a5f5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:33.429094 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0d3ea48e-5e3e-407e-a855-2c992290a5f5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:33.429525 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0d3ea48e-5e3e-407e-a855-2c992290a5f5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:33.565937 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0d3ea48e-5e3e-407e-a855-2c992290a5f5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:33.574039 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0d3ea48e-5e3e-407e-a855-2c992290a5f5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.157856 Jul 12 13:20:33.574516 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 364/731] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:33 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:33.682706 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:20:33.683259 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:20:33.683661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:20:33.684070 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:20:33.684465 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:20:33.693393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:33.693858 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:33.694755 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:33.695214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:33.711896 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:20:33.715996 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Getting quotas for user c8380cfce8114b609c8f0cbf9d445049 and project b19369c5bc0547ccbfcfdfc102d3593c. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:20:33.728455 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:20:33.730737 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:20:33.775844 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cfb1f0f8-786d-4cf1-8fe6-083dbf67135e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.660707 Jul 12 13:20:33.776477 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 368/732] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:20:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:20:33.786546 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e5eedc0c-89d0-4a1e-b782-1adccf55cf03 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:33.787186 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e5eedc0c-89d0-4a1e-b782-1adccf55cf03 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:33.812437 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:33.840560 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e5eedc0c-89d0-4a1e-b782-1adccf55cf03 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:33.847763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e5eedc0c-89d0-4a1e-b782-1adccf55cf03 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1242 microversion: 2.1 time: 0.065019 Jul 12 13:20:33.848345 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 365/733] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:33 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:33.978297 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:33.978990 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:33.985426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:33.985870 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:33.986636 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:33.987108 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:34.022513 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:34.022980 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:34.023415 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lazy-loading 'fault' on Instance uuid 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:20:34.065488 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:34.073929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-1ec27057-d2e1-4255-a18e-49399b3a7d3b tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 200 len: 1310 microversion: 2.1 time: 0.099956 Jul 12 13:20:34.074652 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 369/734] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:33 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:34.591298 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-72f78188-5f1d-4434-94e8-67c8bb3b7b3e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:34.591920 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-72f78188-5f1d-4434-94e8-67c8bb3b7b3e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:34.598729 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72f78188-5f1d-4434-94e8-67c8bb3b7b3e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:34.599213 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72f78188-5f1d-4434-94e8-67c8bb3b7b3e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:34.599973 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72f78188-5f1d-4434-94e8-67c8bb3b7b3e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:34.600431 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-72f78188-5f1d-4434-94e8-67c8bb3b7b3e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:34.734243 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-72f78188-5f1d-4434-94e8-67c8bb3b7b3e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:34.746699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-72f78188-5f1d-4434-94e8-67c8bb3b7b3e tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.159002 Jul 12 13:20:34.747541 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 366/735] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:34 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:34.868256 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b28fc97e-dc51-44dd-952d-6b8829439f0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:34.869218 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b28fc97e-dc51-44dd-952d-6b8829439f0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:34.872934 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:34.880234 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b28fc97e-dc51-44dd-952d-6b8829439f0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:34.881640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b28fc97e-dc51-44dd-952d-6b8829439f0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:34.882315 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b28fc97e-dc51-44dd-952d-6b8829439f0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:34.882902 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b28fc97e-dc51-44dd-952d-6b8829439f0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:34.954909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b28fc97e-dc51-44dd-952d-6b8829439f0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:34.962771 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b28fc97e-dc51-44dd-952d-6b8829439f0e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1294 microversion: 2.1 time: 0.100602 Jul 12 13:20:34.963562 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 370/736] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:34 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:35.092149 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:35.093329 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 882374fe-d7b8-4a2b-a70c-e7d15c9138c1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:35.102106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.102570 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.103485 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.104138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.119411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] HTTP exception thrown: Instance 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 could not be found. Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Request method failure captured: Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 HTTP/1.1 Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPflp1o9WogLAsdDvmSYbq3haIRqeuf6GL6xU3vqmbsanSflHqREzYieLzIoopLz13Y8ZWtiAhuSzGa5XP_uWH_z5C9p8hYLodvCvW6njxHN9XLwyQv63XoytrSUUxgC1j1Sx9JqPFo9z2KdVjTsbxxebQxUx3vj0rtsuddM65GxVY Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: d175790280c1443192810e2b789b9926 Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:20:35.121110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d175790280c1443192810e2b789b9926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d175790280c1443192810e2b789b9926"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: d175790280c1443192810e2b789b9926 Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 9e08af1e7f794f85b57d6912db529577 Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 could not be found. Jul 12 13:20:35.122755 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '882374fe-d7b8-4a2b-a70c-e7d15c9138c1'} Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 could not be found. Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:35.123682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 could not be found. Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 could not be found. Jul 12 13:20:35.125184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:20:35.126492 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Returning 404 to user: Instance 882374fe-d7b8-4a2b-a70c-e7d15c9138c1 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:35.126492 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-39ed176a-da15-4820-ad6e-acc9dd42436e tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1" status: 404 len: 111 microversion: 2.1 time: 0.035065 Jul 12 13:20:35.126492 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 367/737] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:35 2022] GET /compute/v2.1/servers/882374fe-d7b8-4a2b-a70c-e7d15c9138c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:20:35.135693 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b6d93ce8-ba22-4498-b690-4cef502be6e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:35.136209 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b6d93ce8-ba22-4498-b690-4cef502be6e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:35.142586 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6d93ce8-ba22-4498-b690-4cef502be6e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.143052 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6d93ce8-ba22-4498-b690-4cef502be6e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.143812 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6d93ce8-ba22-4498-b690-4cef502be6e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.144235 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b6d93ce8-ba22-4498-b690-4cef502be6e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.169483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b6d93ce8-ba22-4498-b690-4cef502be6e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:20:35.250058 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b6d93ce8-ba22-4498-b690-4cef502be6e6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "DELETE /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 204 len: 0 microversion: 2.1 time: 0.118599 Jul 12 13:20:35.250618 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 371/738] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:20:35 2022] DELETE /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:20:35.260453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c3b2a3f1-ff18-4bf5-8b35-0fdbfd0153b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:35.261056 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c3b2a3f1-ff18-4bf5-8b35-0fdbfd0153b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:35.267105 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3b2a3f1-ff18-4bf5-8b35-0fdbfd0153b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.267538 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3b2a3f1-ff18-4bf5-8b35-0fdbfd0153b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.268265 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3b2a3f1-ff18-4bf5-8b35-0fdbfd0153b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.268687 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3b2a3f1-ff18-4bf5-8b35-0fdbfd0153b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.362231 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-962f8659-b787-4f5c-bf64-0528688f0775 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:35.363226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-962f8659-b787-4f5c-bf64-0528688f0775 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:35.372443 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-962f8659-b787-4f5c-bf64-0528688f0775 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.373079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-962f8659-b787-4f5c-bf64-0528688f0775 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.374048 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-962f8659-b787-4f5c-bf64-0528688f0775 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.374546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-962f8659-b787-4f5c-bf64-0528688f0775 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.469086 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c3b2a3f1-ff18-4bf5-8b35-0fdbfd0153b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:35.479309 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c3b2a3f1-ff18-4bf5-8b35-0fdbfd0153b5 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.223789 Jul 12 13:20:35.480424 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 368/739] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:35 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:35.486233 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-726dd899-0b87-4c07-ab38-b6f33da0ed86 req-6e9caea6-41c8-4a97-83b0-783eedadfbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1b8589-d954-4806-9228-47ea80451712", "name": "network-vif-unplugged", "status": "completed", "tag": "22d70302-4120-482b-8c1c-525d7d7ba7f4"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:35.496558 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-726dd899-0b87-4c07-ab38-b6f33da0ed86 req-6e9caea6-41c8-4a97-83b0-783eedadfbbb service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.497286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-726dd899-0b87-4c07-ab38-b6f33da0ed86 req-6e9caea6-41c8-4a97-83b0-783eedadfbbb service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.513306 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.compute.server_external_events [req-726dd899-0b87-4c07-ab38-b6f33da0ed86 req-6e9caea6-41c8-4a97-83b0-783eedadfbbb service nova] Unable to find a host for instance 5c1b8589-d954-4806-9228-47ea80451712. Dropping event network-vif-unplugged {{(pid=117963) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 13:20:35.514638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-726dd899-0b87-4c07-ab38-b6f33da0ed86 req-6e9caea6-41c8-4a97-83b0-783eedadfbbb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033098 Jul 12 13:20:35.515730 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 369/740] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 13:20:35.538136 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-962f8659-b787-4f5c-bf64-0528688f0775 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:35.546467 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-962f8659-b787-4f5c-bf64-0528688f0775 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1594 microversion: 2.1 time: 0.188439 Jul 12 13:20:35.547052 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 372/741] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:35 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1594 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:35.768114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5eb8503c-5898-453a-a126-5ae9580602b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:35.768776 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5eb8503c-5898-453a-a126-5ae9580602b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:35.775496 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5eb8503c-5898-453a-a126-5ae9580602b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.775940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5eb8503c-5898-453a-a126-5ae9580602b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.776708 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5eb8503c-5898-453a-a126-5ae9580602b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.777139 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5eb8503c-5898-453a-a126-5ae9580602b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.982666 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-421ae240-b230-466e-aeb5-4f158a7c2ab9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:35.983319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-421ae240-b230-466e-aeb5-4f158a7c2ab9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:35.993570 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-421ae240-b230-466e-aeb5-4f158a7c2ab9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.994249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-421ae240-b230-466e-aeb5-4f158a7c2ab9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:35.995129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-421ae240-b230-466e-aeb5-4f158a7c2ab9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:35.995547 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-421ae240-b230-466e-aeb5-4f158a7c2ab9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:36.094681 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-421ae240-b230-466e-aeb5-4f158a7c2ab9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:36.102835 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-421ae240-b230-466e-aeb5-4f158a7c2ab9 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1300 microversion: 2.1 time: 0.124271 Jul 12 13:20:36.107946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 373/742] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:35 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:36.154706 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5eb8503c-5898-453a-a126-5ae9580602b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:36.162255 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5eb8503c-5898-453a-a126-5ae9580602b4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1503 microversion: 2.1 time: 0.398087 Jul 12 13:20:36.162939 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 370/743] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:35 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:36.179363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-74ed5e9b-d398-457f-8205-85ed5c62c91f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:36.179924 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-74ed5e9b-d398-457f-8205-85ed5c62c91f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:36.185888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74ed5e9b-d398-457f-8205-85ed5c62c91f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:36.186325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74ed5e9b-d398-457f-8205-85ed5c62c91f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:36.187105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74ed5e9b-d398-457f-8205-85ed5c62c91f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:36.187532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74ed5e9b-d398-457f-8205-85ed5c62c91f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:36.283003 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-74ed5e9b-d398-457f-8205-85ed5c62c91f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "POST /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712/action" status: 202 len: 0 microversion: 2.1 time: 0.107656 Jul 12 13:20:36.283874 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 374/744] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:20:36 2022] POST /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:20:36.297451 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2ffbdcf1-ab8b-4ce6-a4a5-c8ab3b8d6e81 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:36.298064 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2ffbdcf1-ab8b-4ce6-a4a5-c8ab3b8d6e81 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:36.305236 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2ffbdcf1-ab8b-4ce6-a4a5-c8ab3b8d6e81 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:36.305679 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2ffbdcf1-ab8b-4ce6-a4a5-c8ab3b8d6e81 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:36.306663 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2ffbdcf1-ab8b-4ce6-a4a5-c8ab3b8d6e81 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:36.307128 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2ffbdcf1-ab8b-4ce6-a4a5-c8ab3b8d6e81 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:36.483927 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2ffbdcf1-ab8b-4ce6-a4a5-c8ab3b8d6e81 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:36.493198 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2ffbdcf1-ab8b-4ce6-a4a5-c8ab3b8d6e81 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1511 microversion: 2.1 time: 0.198435 Jul 12 13:20:36.500356 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-848d47b7-29ec-4c3b-85d8-7326823ee9e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:36.503126 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 371/745] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:36 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:36.504010 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-848d47b7-29ec-4c3b-85d8-7326823ee9e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:36.510762 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-848d47b7-29ec-4c3b-85d8-7326823ee9e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:36.511706 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-848d47b7-29ec-4c3b-85d8-7326823ee9e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:36.512534 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-848d47b7-29ec-4c3b-85d8-7326823ee9e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:36.513037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-848d47b7-29ec-4c3b-85d8-7326823ee9e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:36.771828 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-848d47b7-29ec-4c3b-85d8-7326823ee9e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:36.779720 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-848d47b7-29ec-4c3b-85d8-7326823ee9e8 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.286751 Jul 12 13:20:36.789283 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 375/746] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:36 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:37.120757 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9f13073e-79e2-4daf-8a4d-5a13827330f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:37.121492 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9f13073e-79e2-4daf-8a4d-5a13827330f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:37.128345 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f13073e-79e2-4daf-8a4d-5a13827330f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:37.128885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f13073e-79e2-4daf-8a4d-5a13827330f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:37.129699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f13073e-79e2-4daf-8a4d-5a13827330f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:37.130218 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9f13073e-79e2-4daf-8a4d-5a13827330f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:37.200154 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9f13073e-79e2-4daf-8a4d-5a13827330f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:37.208261 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9f13073e-79e2-4daf-8a4d-5a13827330f4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1300 microversion: 2.1 time: 0.091380 Jul 12 13:20:37.209084 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 372/747] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:37 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:37.268576 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c0e29530-8181-42db-9e1d-37f834d4bc93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:37.269080 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c0e29530-8181-42db-9e1d-37f834d4bc93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:37.275305 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0e29530-8181-42db-9e1d-37f834d4bc93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:37.275741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0e29530-8181-42db-9e1d-37f834d4bc93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:37.276468 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0e29530-8181-42db-9e1d-37f834d4bc93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:37.276888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c0e29530-8181-42db-9e1d-37f834d4bc93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:37.300623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c0e29530-8181-42db-9e1d-37f834d4bc93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/ips" status: 200 len: 152 microversion: 2.20 time: 0.154670 Jul 12 13:20:37.301954 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 376/748] 10.222.0.33 () {60 vars in 1288 bytes} [Tue Jul 12 13:20:37 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/ips => generated 152 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:20:37.510032 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-99ef95fd-6ad0-40f5-bae6-684397e591fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:37.510776 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-99ef95fd-6ad0-40f5-bae6-684397e591fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:37.517154 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99ef95fd-6ad0-40f5-bae6-684397e591fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:37.517686 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99ef95fd-6ad0-40f5-bae6-684397e591fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:37.518545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99ef95fd-6ad0-40f5-bae6-684397e591fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:37.519076 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99ef95fd-6ad0-40f5-bae6-684397e591fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:37.700855 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-99ef95fd-6ad0-40f5-bae6-684397e591fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:37.712343 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-99ef95fd-6ad0-40f5-bae6-684397e591fc tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1511 microversion: 2.1 time: 0.205119 Jul 12 13:20:37.712907 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 373/749] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:37 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:37.739631 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-4fe77e35-ef97-432b-bd5a-20269cd52396 req-3b40a62e-e52c-4b89-880d-c91e7b403822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace38168-9c22-45ee-9115-1dcc8f236117", "tag": "2b671be9-4c90-497b-a3b6-75b9a1ced246"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:37.749731 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-4fe77e35-ef97-432b-bd5a-20269cd52396 req-3b40a62e-e52c-4b89-880d-c91e7b403822 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:37.750855 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-4fe77e35-ef97-432b-bd5a-20269cd52396 req-3b40a62e-e52c-4b89-880d-c91e7b403822 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:37.763643 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-4fe77e35-ef97-432b-bd5a-20269cd52396 req-3b40a62e-e52c-4b89-880d-c91e7b403822 service nova] Creating event network-changed:2b671be9-4c90-497b-a3b6-75b9a1ced246 for instance ace38168-9c22-45ee-9115-1dcc8f236117 on hv-cinder-79760 Jul 12 13:20:37.771187 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-4fe77e35-ef97-432b-bd5a-20269cd52396 req-3b40a62e-e52c-4b89-880d-c91e7b403822 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091323 Jul 12 13:20:37.772759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 377/750] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:37.797533 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2399e1cb-ae45-457b-b831-8cca3da97cbe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:37.798186 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2399e1cb-ae45-457b-b831-8cca3da97cbe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:37.804639 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2399e1cb-ae45-457b-b831-8cca3da97cbe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:37.805155 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2399e1cb-ae45-457b-b831-8cca3da97cbe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:37.805826 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2399e1cb-ae45-457b-b831-8cca3da97cbe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:37.806251 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2399e1cb-ae45-457b-b831-8cca3da97cbe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:37.950786 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2399e1cb-ae45-457b-b831-8cca3da97cbe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:37.960625 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2399e1cb-ae45-457b-b831-8cca3da97cbe tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.166073 Jul 12 13:20:37.970747 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 374/751] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:37 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:38.230755 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4795feed-a00c-4d27-aeec-cff01cc3eea0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:38.231791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4795feed-a00c-4d27-aeec-cff01cc3eea0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:38.239661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4795feed-a00c-4d27-aeec-cff01cc3eea0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:38.240092 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4795feed-a00c-4d27-aeec-cff01cc3eea0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:38.241380 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4795feed-a00c-4d27-aeec-cff01cc3eea0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:38.241523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4795feed-a00c-4d27-aeec-cff01cc3eea0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:38.318715 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4795feed-a00c-4d27-aeec-cff01cc3eea0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:38.328473 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4795feed-a00c-4d27-aeec-cff01cc3eea0 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1300 microversion: 2.1 time: 0.107676 Jul 12 13:20:38.329030 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 378/752] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:38 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:38.723736 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-98e031b2-0c6f-497a-9805-c163c3abcf1f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-571207591"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:38.724447 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-98e031b2-0c6f-497a-9805-c163c3abcf1f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:38.730229 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3c75b838-bba7-4184-abad-839ca7fc4b90 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:38.730865 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3c75b838-bba7-4184-abad-839ca7fc4b90 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:38.731617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98e031b2-0c6f-497a-9805-c163c3abcf1f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:38.732062 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98e031b2-0c6f-497a-9805-c163c3abcf1f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:38.732820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98e031b2-0c6f-497a-9805-c163c3abcf1f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:38.733247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-98e031b2-0c6f-497a-9805-c163c3abcf1f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:38.742389 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c75b838-bba7-4184-abad-839ca7fc4b90 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:38.742840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c75b838-bba7-4184-abad-839ca7fc4b90 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:38.743650 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c75b838-bba7-4184-abad-839ca7fc4b90 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:38.744081 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3c75b838-bba7-4184-abad-839ca7fc4b90 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:38.916650 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3c75b838-bba7-4184-abad-839ca7fc4b90 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:38.919931 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:38.931043 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3c75b838-bba7-4184-abad-839ca7fc4b90 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1511 microversion: 2.1 time: 0.204516 Jul 12 13:20:38.931637 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 379/753] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:38 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:38.978290 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9b6b7655-ea2e-4b67-840f-8a456793fbda tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:38.979922 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9b6b7655-ea2e-4b67-840f-8a456793fbda tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:38.987629 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9b6b7655-ea2e-4b67-840f-8a456793fbda tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:38.987951 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9b6b7655-ea2e-4b67-840f-8a456793fbda tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:38.988719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9b6b7655-ea2e-4b67-840f-8a456793fbda tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:38.989144 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9b6b7655-ea2e-4b67-840f-8a456793fbda tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:39.023542 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.network.security_group_api [None req-98e031b2-0c6f-497a-9805-c163c3abcf1f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Adding security group 22e350cb-0153-47ce-9e09-2729bceb85e3 to port 2b671be9-4c90-497b-a3b6-75b9a1ced246 Jul 12 13:20:39.137291 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9b6b7655-ea2e-4b67-840f-8a456793fbda tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:39.155552 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9b6b7655-ea2e-4b67-840f-8a456793fbda tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1520 microversion: 2.1 time: 0.181748 Jul 12 13:20:39.156142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 380/754] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:38 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:39.318445 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9821a264-5e95-4cdd-8dae-fbecf6efa6ac tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:39.319395 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9821a264-5e95-4cdd-8dae-fbecf6efa6ac tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:39.326600 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9821a264-5e95-4cdd-8dae-fbecf6efa6ac tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:39.327438 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9821a264-5e95-4cdd-8dae-fbecf6efa6ac tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:39.328909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9821a264-5e95-4cdd-8dae-fbecf6efa6ac tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:39.329430 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9821a264-5e95-4cdd-8dae-fbecf6efa6ac tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:39.356279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-9821a264-5e95-4cdd-8dae-fbecf6efa6ac tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lazy-loading 'flavor' on Instance uuid 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:20:39.663253 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9821a264-5e95-4cdd-8dae-fbecf6efa6ac tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/action" status: 202 len: 0 microversion: 2.20 time: 0.348691 Jul 12 13:20:39.664024 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 381/755] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 12 13:20:39 2022] POST /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:20:39.671911 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8eb9a398-2821-4833-ae7a-7769f1f7f592 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:39.672923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8eb9a398-2821-4833-ae7a-7769f1f7f592 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:39.682911 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8eb9a398-2821-4833-ae7a-7769f1f7f592 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:39.683082 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8eb9a398-2821-4833-ae7a-7769f1f7f592 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:39.684715 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8eb9a398-2821-4833-ae7a-7769f1f7f592 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:39.685982 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8eb9a398-2821-4833-ae7a-7769f1f7f592 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:39.879981 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8eb9a398-2821-4833-ae7a-7769f1f7f592 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:39.886394 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-98e031b2-0c6f-497a-9805-c163c3abcf1f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "POST /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/action" status: 202 len: 0 microversion: 2.1 time: 1.166315 Jul 12 13:20:39.888026 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 375/756] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:20:38 2022] POST /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/action => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:20:39.893851 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:39.894505 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:39.901160 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8eb9a398-2821-4833-ae7a-7769f1f7f592 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1368 microversion: 2.1 time: 0.235418 Jul 12 13:20:39.902256 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:39.902707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:39.903499 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:39.904172 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:39.905598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 382/757] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:39 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:39.920648 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-80ea9988-6498-49d3-ac99-b00900b118dc req-fa3c62bd-b99e-45a8-acc9-6372b583f7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185dde2b-5476-49f7-bf9d-65a6170bbbc7", "name": "network-vif-deleted", "tag": "c0df3222-7842-45d4-a55f-acc681bd613c"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:39.992599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-80ea9988-6498-49d3-ac99-b00900b118dc req-fa3c62bd-b99e-45a8-acc9-6372b583f7a7 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:39.995522 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-80ea9988-6498-49d3-ac99-b00900b118dc req-fa3c62bd-b99e-45a8-acc9-6372b583f7a7 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.026532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-80ea9988-6498-49d3-ac99-b00900b118dc req-fa3c62bd-b99e-45a8-acc9-6372b583f7a7 service nova] Creating event network-vif-deleted:c0df3222-7842-45d4-a55f-acc681bd613c for instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 on hv-cinder-79760 Jul 12 13:20:40.039752 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-80ea9988-6498-49d3-ac99-b00900b118dc req-fa3c62bd-b99e-45a8-acc9-6372b583f7a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132376 Jul 12 13:20:40.042862 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 383/758] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:40.056345 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-56bffaaf-1633-441f-ad5c-234c543e295f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:40.062940 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-56bffaaf-1633-441f-ad5c-234c543e295f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:40.071495 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-56bffaaf-1633-441f-ad5c-234c543e295f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.073013 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-56bffaaf-1633-441f-ad5c-234c543e295f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.073589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-56bffaaf-1633-441f-ad5c-234c543e295f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.074508 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-56bffaaf-1633-441f-ad5c-234c543e295f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.293358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-56bffaaf-1633-441f-ad5c-234c543e295f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:40.315812 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:40.333118 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:40.335086 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:40.336146 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-56bffaaf-1633-441f-ad5c-234c543e295f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1640 microversion: 2.1 time: 0.283748 Jul 12 13:20:40.338170 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 384/759] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:40 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1640 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:40.339072 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-018d9564-8c1f-49cb-82d7-cadfc34a905c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.449809 Jul 12 13:20:40.350815 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 376/760] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:39 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:40.361822 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-255b4389-5eb1-4b7e-bb64-308c91074bb5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:40.362506 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-255b4389-5eb1-4b7e-bb64-308c91074bb5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:40.376206 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-255b4389-5eb1-4b7e-bb64-308c91074bb5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.376666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-255b4389-5eb1-4b7e-bb64-308c91074bb5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.377431 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-255b4389-5eb1-4b7e-bb64-308c91074bb5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.377834 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-255b4389-5eb1-4b7e-bb64-308c91074bb5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.482457 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-4ad39faa-e1a1-4b2d-8d25-d0323e1e364d req-557f8861-8e33-4e55-8a5a-d21196d7157f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace38168-9c22-45ee-9115-1dcc8f236117", "tag": "2b671be9-4c90-497b-a3b6-75b9a1ced246"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:40.495735 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-4ad39faa-e1a1-4b2d-8d25-d0323e1e364d req-557f8861-8e33-4e55-8a5a-d21196d7157f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.496478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-4ad39faa-e1a1-4b2d-8d25-d0323e1e364d req-557f8861-8e33-4e55-8a5a-d21196d7157f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.514307 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-4ad39faa-e1a1-4b2d-8d25-d0323e1e364d req-557f8861-8e33-4e55-8a5a-d21196d7157f service nova] Creating event network-changed:2b671be9-4c90-497b-a3b6-75b9a1ced246 for instance ace38168-9c22-45ee-9115-1dcc8f236117 on hv-cinder-79760 Jul 12 13:20:40.524381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-4ad39faa-e1a1-4b2d-8d25-d0323e1e364d req-557f8861-8e33-4e55-8a5a-d21196d7157f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184788 Jul 12 13:20:40.526553 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 385/761] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:40.532580 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:40.534072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:40.542758 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.543441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.544393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.545128 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.619219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.620021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.620659 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lazy-loading 'fault' on Instance uuid 185dde2b-5476-49f7-bf9d-65a6170bbbc7 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:20:40.675238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e08af1e7f794f85b57d6912db529577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd175790280c1443192810e2b789b9926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:40.691373 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a7daf953-1a34-4503-a8e8-3b8c7e46c5ed tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 200 len: 1311 microversion: 2.1 time: 0.161053 Jul 12 13:20:40.692715 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 386/762] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:40 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:40.747286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-255b4389-5eb1-4b7e-bb64-308c91074bb5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:40.759333 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-255b4389-5eb1-4b7e-bb64-308c91074bb5 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1513 microversion: 2.1 time: 0.406021 Jul 12 13:20:40.760055 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 377/763] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:40 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1513 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:40.922466 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b1a562a2-9654-4def-888c-527030775339 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:40.923111 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b1a562a2-9654-4def-888c-527030775339 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:40.930544 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b1a562a2-9654-4def-888c-527030775339 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.931323 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b1a562a2-9654-4def-888c-527030775339 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:40.932454 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b1a562a2-9654-4def-888c-527030775339 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:40.933238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b1a562a2-9654-4def-888c-527030775339 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:41.153177 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b1a562a2-9654-4def-888c-527030775339 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:41.161485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b1a562a2-9654-4def-888c-527030775339 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1368 microversion: 2.1 time: 0.243096 Jul 12 13:20:41.162173 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 387/764] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:40 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:41.357899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:41.358515 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:41.365054 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:41.365913 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:41.367071 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:41.367726 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:41.697113 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:41.707598 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:41.710151 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:41.712690 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:41.713220 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-20ac8a09-0ea2-46ab-a1c8-c9145be3a4b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.358612 Jul 12 13:20:41.713719 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 378/765] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:41 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:41.714700 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] [instance: 185dde2b-5476-49f7-bf9d-65a6170bbbc7] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:41.721969 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:41.722727 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:41.723790 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:41.724292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:41.739664 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] HTTP exception thrown: Instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 could not be found. Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Request method failure captured: Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 HTTP/1.1 Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPflp1o9WogLAsdDvmSYbq3haIRqeuf6GL6xU3vqmbsanSflHqREzYieLzIoopLz13Y8ZWtiAhuSzGa5XP_uWH_z5C9p8hYLodvCvW6njxHN9XLwyQv63XoytrSUUxgC1j1Sx9JqPFo9z2KdVjTsbxxebQxUx3vj0rtsuddM65GxVY Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: d175790280c1443192810e2b789b9926 Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:20:41.742123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d175790280c1443192810e2b789b9926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d175790280c1443192810e2b789b9926"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d175790280c1443192810e2b789b9926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: d175790280c1443192810e2b789b9926 Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-180205865 Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 9e08af1e7f794f85b57d6912db529577 Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-ServerRescueNegativeTestJSON-180205865-project Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 could not be found. Jul 12 13:20:41.743869 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '185dde2b-5476-49f7-bf9d-65a6170bbbc7'} Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 could not be found. Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:20:41.744807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 could not be found. Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 could not be found. Jul 12 13:20:41.746561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:20:41.747975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] Returning 404 to user: Instance 185dde2b-5476-49f7-bf9d-65a6170bbbc7 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:20:41.747975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2b5ed841-ee25-4548-a6c0-5c27174104d6 tempest-ServerRescueNegativeTestJSON-180205865 tempest-ServerRescueNegativeTestJSON-180205865-project] 10.222.0.33 "GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7" status: 404 len: 111 microversion: 2.1 time: 0.038834 Jul 12 13:20:41.750366 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 388/766] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:41 2022] GET /compute/v2.1/servers/185dde2b-5476-49f7-bf9d-65a6170bbbc7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:20:41.778251 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4a44b99f-f1e2-4363-9374-8529c1a1cb70 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:41.778916 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4a44b99f-f1e2-4363-9374-8529c1a1cb70 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:41.785668 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a44b99f-f1e2-4363-9374-8529c1a1cb70 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:41.786110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a44b99f-f1e2-4363-9374-8529c1a1cb70 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:41.786906 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a44b99f-f1e2-4363-9374-8529c1a1cb70 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:41.787861 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4a44b99f-f1e2-4363-9374-8529c1a1cb70 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:42.179239 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b11545dc-e62a-4fb5-8806-8e2c35f8601c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:42.180096 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b11545dc-e62a-4fb5-8806-8e2c35f8601c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:42.197599 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b11545dc-e62a-4fb5-8806-8e2c35f8601c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:42.198197 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b11545dc-e62a-4fb5-8806-8e2c35f8601c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:42.199159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b11545dc-e62a-4fb5-8806-8e2c35f8601c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:42.199771 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b11545dc-e62a-4fb5-8806-8e2c35f8601c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:42.336789 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b11545dc-e62a-4fb5-8806-8e2c35f8601c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:42.344814 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b11545dc-e62a-4fb5-8806-8e2c35f8601c tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1368 microversion: 2.1 time: 0.169560 Jul 12 13:20:42.345584 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 389/767] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:42 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:42.416298 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4a44b99f-f1e2-4363-9374-8529c1a1cb70 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:42.419990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:42.424617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4a44b99f-f1e2-4363-9374-8529c1a1cb70 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.650366 Jul 12 13:20:42.425337 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 379/768] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:41 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:42.576364 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-eacdb043-b581-4519-b5fe-ede51a9ed408 req-64b47fca-9213-4a5e-8cc7-6554f39271d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5827330e-7872-4e44-8fce-856ad3d2288a", "tag": "782480f4-c49a-4f49-8e72-6122c9083b2b"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:42.585448 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-eacdb043-b581-4519-b5fe-ede51a9ed408 req-64b47fca-9213-4a5e-8cc7-6554f39271d8 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:42.586204 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-eacdb043-b581-4519-b5fe-ede51a9ed408 req-64b47fca-9213-4a5e-8cc7-6554f39271d8 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:42.604927 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-eacdb043-b581-4519-b5fe-ede51a9ed408 req-64b47fca-9213-4a5e-8cc7-6554f39271d8 service nova] Creating event network-changed:782480f4-c49a-4f49-8e72-6122c9083b2b for instance 5827330e-7872-4e44-8fce-856ad3d2288a on hv-cinder-79760 Jul 12 13:20:42.609934 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-eacdb043-b581-4519-b5fe-ede51a9ed408 req-64b47fca-9213-4a5e-8cc7-6554f39271d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037461 Jul 12 13:20:42.610692 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 390/769] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:42.731608 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:42.732289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:42.738739 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:42.739285 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:42.740142 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:42.740537 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:43.021162 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:43.030004 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:43.031543 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:43.032719 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8af5cc92-bb9e-4bc9-8d85-cc6fda078ecd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.305142 Jul 12 13:20:43.033323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 380/770] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:42 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:43.362867 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-58db1a15-bc82-4c39-84be-0d599a224840 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:43.363731 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-58db1a15-bc82-4c39-84be-0d599a224840 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:43.371254 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-58db1a15-bc82-4c39-84be-0d599a224840 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:43.371769 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-58db1a15-bc82-4c39-84be-0d599a224840 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:43.372596 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-58db1a15-bc82-4c39-84be-0d599a224840 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:43.373075 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-58db1a15-bc82-4c39-84be-0d599a224840 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:43.441701 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-922cfe8d-377b-4b34-ad71-08f658856610 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:43.443634 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-922cfe8d-377b-4b34-ad71-08f658856610 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:43.451967 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-922cfe8d-377b-4b34-ad71-08f658856610 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:43.452748 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-922cfe8d-377b-4b34-ad71-08f658856610 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:43.454035 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-922cfe8d-377b-4b34-ad71-08f658856610 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:43.454800 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-922cfe8d-377b-4b34-ad71-08f658856610 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:43.524376 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-58db1a15-bc82-4c39-84be-0d599a224840 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:43.533201 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-58db1a15-bc82-4c39-84be-0d599a224840 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1368 microversion: 2.1 time: 0.174577 Jul 12 13:20:43.534004 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 391/771] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:43 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:43.844817 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:44.020732 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-922cfe8d-377b-4b34-ad71-08f658856610 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:44.028878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-922cfe8d-377b-4b34-ad71-08f658856610 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.590997 Jul 12 13:20:44.029790 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 381/772] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:43 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:44.052377 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:44.053282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:44.055586 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:44.056382 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=10 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:44.063204 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:44.064519 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:44.065325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:44.068583 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:44.222357 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:44.231228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:44.232682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:44.233964 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6b6eb7bd-4760-4625-baae-e7db9cf7345a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.186149 Jul 12 13:20:44.234510 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 392/773] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:44 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:44.551326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f649c02b-66f4-44ce-a3aa-3ab2b119d4e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:44.551961 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f649c02b-66f4-44ce-a3aa-3ab2b119d4e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:44.558860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f649c02b-66f4-44ce-a3aa-3ab2b119d4e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:44.559347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f649c02b-66f4-44ce-a3aa-3ab2b119d4e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:44.560118 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f649c02b-66f4-44ce-a3aa-3ab2b119d4e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:44.560556 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f649c02b-66f4-44ce-a3aa-3ab2b119d4e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:44.790535 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f649c02b-66f4-44ce-a3aa-3ab2b119d4e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:44.798970 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f649c02b-66f4-44ce-a3aa-3ab2b119d4e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1368 microversion: 2.1 time: 0.251746 Jul 12 13:20:44.799685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 382/774] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:44 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:45.046815 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4f3eae5b-a682-4d11-b1cf-2627d6355aec tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:45.047681 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4f3eae5b-a682-4d11-b1cf-2627d6355aec tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:45.055448 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4f3eae5b-a682-4d11-b1cf-2627d6355aec tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:45.055870 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4f3eae5b-a682-4d11-b1cf-2627d6355aec tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:45.056999 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4f3eae5b-a682-4d11-b1cf-2627d6355aec tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:45.057464 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4f3eae5b-a682-4d11-b1cf-2627d6355aec tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:45.202302 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4f3eae5b-a682-4d11-b1cf-2627d6355aec tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:45.217123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4f3eae5b-a682-4d11-b1cf-2627d6355aec tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.174950 Jul 12 13:20:45.217749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 393/775] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:45 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:45.253654 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:45.254263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:45.260597 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:45.261042 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:45.261807 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:45.262240 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:45.559317 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:45.569351 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:45.571005 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:45.572323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d9fac36e-7478-4424-815c-9c6db5ee628a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.322817 Jul 12 13:20:45.573603 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 383/776] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:45 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:45.816650 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-75df37c6-02aa-46a5-83f1-ef3a279520a4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:45.817404 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-75df37c6-02aa-46a5-83f1-ef3a279520a4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:45.823969 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75df37c6-02aa-46a5-83f1-ef3a279520a4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:45.824705 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75df37c6-02aa-46a5-83f1-ef3a279520a4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:45.825586 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75df37c6-02aa-46a5-83f1-ef3a279520a4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:45.826151 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75df37c6-02aa-46a5-83f1-ef3a279520a4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:46.007566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-75df37c6-02aa-46a5-83f1-ef3a279520a4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:46.019831 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-75df37c6-02aa-46a5-83f1-ef3a279520a4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1368 microversion: 2.1 time: 0.206676 Jul 12 13:20:46.021486 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 394/777] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:45 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:46.236530 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2dae8d5f-4c27-4fb4-a295-b31176a605a4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:46.237366 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2dae8d5f-4c27-4fb4-a295-b31176a605a4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:46.247637 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dae8d5f-4c27-4fb4-a295-b31176a605a4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:46.248306 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dae8d5f-4c27-4fb4-a295-b31176a605a4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:46.250048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dae8d5f-4c27-4fb4-a295-b31176a605a4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:46.250643 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2dae8d5f-4c27-4fb4-a295-b31176a605a4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:46.490916 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2dae8d5f-4c27-4fb4-a295-b31176a605a4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:46.499779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2dae8d5f-4c27-4fb4-a295-b31176a605a4 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.267842 Jul 12 13:20:46.500378 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 384/778] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:46 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:46.591627 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:46.592236 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:46.598827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:46.599371 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:46.600203 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:46.600636 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:46.773561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:46.786025 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:46.788571 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:46.789787 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-790368ca-469f-4ca1-9441-4007a120b8db tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.202110 Jul 12 13:20:46.790350 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 395/779] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:46 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:47.036500 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-61ab00d6-0b33-420c-876f-6ac497e3b99b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:47.037101 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-61ab00d6-0b33-420c-876f-6ac497e3b99b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:47.043679 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-61ab00d6-0b33-420c-876f-6ac497e3b99b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:47.044121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-61ab00d6-0b33-420c-876f-6ac497e3b99b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:47.044988 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-61ab00d6-0b33-420c-876f-6ac497e3b99b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:47.045410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-61ab00d6-0b33-420c-876f-6ac497e3b99b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:47.176432 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-61ab00d6-0b33-420c-876f-6ac497e3b99b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:47.184519 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-61ab00d6-0b33-420c-876f-6ac497e3b99b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1368 microversion: 2.1 time: 0.151900 Jul 12 13:20:47.185088 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 385/780] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:47 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:47.517963 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ac3145af-75a0-4784-8b28-931ec8f50174 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:47.519024 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ac3145af-75a0-4784-8b28-931ec8f50174 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:47.525437 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ac3145af-75a0-4784-8b28-931ec8f50174 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:47.525892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ac3145af-75a0-4784-8b28-931ec8f50174 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:47.526627 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ac3145af-75a0-4784-8b28-931ec8f50174 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:47.527240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ac3145af-75a0-4784-8b28-931ec8f50174 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:47.688485 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ac3145af-75a0-4784-8b28-931ec8f50174 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:47.693186 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:47.698710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ac3145af-75a0-4784-8b28-931ec8f50174 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.184897 Jul 12 13:20:47.699684 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 396/781] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:47 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:47.731125 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-ff7312a2-8ee3-487b-82b5-97393f83da3b req-c73ed5a5-18cd-4c93-8618-d9f3faf5b447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5827330e-7872-4e44-8fce-856ad3d2288a", "name": "network-vif-plugged", "status": "completed", "tag": "782480f4-c49a-4f49-8e72-6122c9083b2b"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:47.739390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ff7312a2-8ee3-487b-82b5-97393f83da3b req-c73ed5a5-18cd-4c93-8618-d9f3faf5b447 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:47.739841 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ff7312a2-8ee3-487b-82b5-97393f83da3b req-c73ed5a5-18cd-4c93-8618-d9f3faf5b447 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:47.750781 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-ff7312a2-8ee3-487b-82b5-97393f83da3b req-c73ed5a5-18cd-4c93-8618-d9f3faf5b447 service nova] Creating event network-vif-plugged:782480f4-c49a-4f49-8e72-6122c9083b2b for instance 5827330e-7872-4e44-8fce-856ad3d2288a on hv-cinder-79760 Jul 12 13:20:47.756069 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-ff7312a2-8ee3-487b-82b5-97393f83da3b req-c73ed5a5-18cd-4c93-8618-d9f3faf5b447 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171546 Jul 12 13:20:47.756813 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 386/782] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:20:47.808606 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:47.809298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:47.816294 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:47.816754 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:47.817515 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:47.817941 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:47.960424 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:47.968916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:47.970857 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:47.972611 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6af4fe29-6182-4d59-96e5-317cd9d4f265 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.168560 Jul 12 13:20:47.973239 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 397/783] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:47 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:20:48.203380 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b9b883e8-16b8-4dfb-8109-4fee29a59b4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:48.203970 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b9b883e8-16b8-4dfb-8109-4fee29a59b4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:48.216361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b9b883e8-16b8-4dfb-8109-4fee29a59b4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:48.216798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b9b883e8-16b8-4dfb-8109-4fee29a59b4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:48.217651 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b9b883e8-16b8-4dfb-8109-4fee29a59b4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:48.218093 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b9b883e8-16b8-4dfb-8109-4fee29a59b4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:48.355124 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b9b883e8-16b8-4dfb-8109-4fee29a59b4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:48.362997 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b9b883e8-16b8-4dfb-8109-4fee29a59b4a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1368 microversion: 2.1 time: 0.164993 Jul 12 13:20:48.363551 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 387/784] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:48 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:48.716138 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a42f1d4a-10a8-4ea9-aed4-1439334a2873 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:48.716841 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a42f1d4a-10a8-4ea9-aed4-1439334a2873 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:48.723958 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a42f1d4a-10a8-4ea9-aed4-1439334a2873 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:48.724394 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a42f1d4a-10a8-4ea9-aed4-1439334a2873 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:48.725135 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a42f1d4a-10a8-4ea9-aed4-1439334a2873 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:48.725682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a42f1d4a-10a8-4ea9-aed4-1439334a2873 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:48.885035 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a42f1d4a-10a8-4ea9-aed4-1439334a2873 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:48.893662 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a42f1d4a-10a8-4ea9-aed4-1439334a2873 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.181908 Jul 12 13:20:48.894304 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 398/785] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:48 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:48.996445 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:48.997446 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:49.007970 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:49.008412 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:49.009194 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:49.009612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:49.146033 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:49.155130 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:49.156577 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:49.157728 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4c853887-0903-4ccf-90c1-99ef633f198a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.168269 Jul 12 13:20:49.158289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 388/786] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:48 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:49.386493 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9abe091e-b0ce-480c-85e1-8d911b6bedd6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:49.387041 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9abe091e-b0ce-480c-85e1-8d911b6bedd6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:49.393586 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9abe091e-b0ce-480c-85e1-8d911b6bedd6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:49.394023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9abe091e-b0ce-480c-85e1-8d911b6bedd6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:49.394790 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9abe091e-b0ce-480c-85e1-8d911b6bedd6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:49.395228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9abe091e-b0ce-480c-85e1-8d911b6bedd6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:49.526510 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9abe091e-b0ce-480c-85e1-8d911b6bedd6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:49.534983 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9abe091e-b0ce-480c-85e1-8d911b6bedd6 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1558 microversion: 2.1 time: 0.155937 Jul 12 13:20:49.535589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 399/787] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:49 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:49.552020 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1000e426-c411-421a-9219-c66ca916c5fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:49.552507 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1000e426-c411-421a-9219-c66ca916c5fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:49.558780 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1000e426-c411-421a-9219-c66ca916c5fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:49.559234 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1000e426-c411-421a-9219-c66ca916c5fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:49.559978 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1000e426-c411-421a-9219-c66ca916c5fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:49.560400 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1000e426-c411-421a-9219-c66ca916c5fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:49.641246 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1000e426-c411-421a-9219-c66ca916c5fc tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093005 Jul 12 13:20:49.641891 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 389/788] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 12 13:20:49 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:49.913478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-75dc6705-67f2-451c-a640-ad822da34402 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:49.915220 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-75dc6705-67f2-451c-a640-ad822da34402 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:49.923607 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75dc6705-67f2-451c-a640-ad822da34402 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:49.924222 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75dc6705-67f2-451c-a640-ad822da34402 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:49.925310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75dc6705-67f2-451c-a640-ad822da34402 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:49.926246 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-75dc6705-67f2-451c-a640-ad822da34402 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:50.106927 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-75dc6705-67f2-451c-a640-ad822da34402 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:50.118463 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-75dc6705-67f2-451c-a640-ad822da34402 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.210704 Jul 12 13:20:50.120118 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 400/789] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:49 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:20:50.177362 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:50.177969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:50.184460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:50.185153 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:50.186562 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:50.187025 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:50.437628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:50.445991 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:50.447530 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:50.448702 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0239ccf8-f7d4-4afe-bf7f-3db8d4c4bda2 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.275752 Jul 12 13:20:50.449272 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 390/790] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:50 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:51.042860 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-3b022388-04fb-48bb-a508-52de3cf34c96 req-c8aa5144-6dfc-4884-acf5-b4f4eb23bc71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5827330e-7872-4e44-8fce-856ad3d2288a", "tag": "782480f4-c49a-4f49-8e72-6122c9083b2b"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:51.051968 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-3b022388-04fb-48bb-a508-52de3cf34c96 req-c8aa5144-6dfc-4884-acf5-b4f4eb23bc71 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:51.052411 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-3b022388-04fb-48bb-a508-52de3cf34c96 req-c8aa5144-6dfc-4884-acf5-b4f4eb23bc71 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:51.064114 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-3b022388-04fb-48bb-a508-52de3cf34c96 req-c8aa5144-6dfc-4884-acf5-b4f4eb23bc71 service nova] Creating event network-changed:782480f4-c49a-4f49-8e72-6122c9083b2b for instance 5827330e-7872-4e44-8fce-856ad3d2288a on hv-cinder-79760 Jul 12 13:20:51.069852 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-3b022388-04fb-48bb-a508-52de3cf34c96 req-c8aa5144-6dfc-4884-acf5-b4f4eb23bc71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030974 Jul 12 13:20:51.070464 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 401/791] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:51.136543 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0badb899-f45b-43a8-9a08-013881da7386 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:51.137178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0badb899-f45b-43a8-9a08-013881da7386 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:51.143724 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0badb899-f45b-43a8-9a08-013881da7386 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:51.144286 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0badb899-f45b-43a8-9a08-013881da7386 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:51.145123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0badb899-f45b-43a8-9a08-013881da7386 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:51.145622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0badb899-f45b-43a8-9a08-013881da7386 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:51.407883 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0badb899-f45b-43a8-9a08-013881da7386 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:51.420032 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0badb899-f45b-43a8-9a08-013881da7386 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.286958 Jul 12 13:20:51.420683 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 391/792] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:51 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:51.470089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:51.473496 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:51.485250 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:51.485784 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:51.486458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:51.486893 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:51.633643 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:51.643965 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:51.645531 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:51.646639 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-752940ec-9b01-462e-a8ed-193231a90a2f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.182580 Jul 12 13:20:51.651103 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 402/793] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:51 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:51.691613 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-9436c019-cc31-464c-a8d7-f9156f0966a9 req-41fbce89-0fa2-4343-b69a-9713eb07746e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1b8589-d954-4806-9228-47ea80451712", "name": "network-vif-plugged", "status": "completed", "tag": "22d70302-4120-482b-8c1c-525d7d7ba7f4"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:51.700341 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-9436c019-cc31-464c-a8d7-f9156f0966a9 req-41fbce89-0fa2-4343-b69a-9713eb07746e service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:51.700788 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-9436c019-cc31-464c-a8d7-f9156f0966a9 req-41fbce89-0fa2-4343-b69a-9713eb07746e service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:51.712201 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-9436c019-cc31-464c-a8d7-f9156f0966a9 req-41fbce89-0fa2-4343-b69a-9713eb07746e service nova] Creating event network-vif-plugged:22d70302-4120-482b-8c1c-525d7d7ba7f4 for instance 5c1b8589-d954-4806-9228-47ea80451712 on hv-cinder-79760 Jul 12 13:20:51.717707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-9436c019-cc31-464c-a8d7-f9156f0966a9 req-41fbce89-0fa2-4343-b69a-9713eb07746e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029549 Jul 12 13:20:51.718350 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 392/794] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:52.440023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4aa9469a-987a-4eef-825b-c5863c7ca48a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:52.440871 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4aa9469a-987a-4eef-825b-c5863c7ca48a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:52.450470 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4aa9469a-987a-4eef-825b-c5863c7ca48a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:52.451154 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4aa9469a-987a-4eef-825b-c5863c7ca48a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:52.452245 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4aa9469a-987a-4eef-825b-c5863c7ca48a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:52.452862 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4aa9469a-987a-4eef-825b-c5863c7ca48a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:52.606257 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4aa9469a-987a-4eef-825b-c5863c7ca48a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:52.615789 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4aa9469a-987a-4eef-825b-c5863c7ca48a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.181166 Jul 12 13:20:52.616647 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 403/795] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:52 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:52.669035 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:52.669791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:52.677329 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:52.677824 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:52.678717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:52.679240 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:52.817030 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:52.825705 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:52.827213 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:52.828362 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-488b3c5a-ba98-42f7-a198-4763fd0f7cfd tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.166006 Jul 12 13:20:52.828893 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 393/796] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:52 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:53.642435 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ec63cebe-1554-41d1-aa7f-8423f05f27cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:53.643386 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ec63cebe-1554-41d1-aa7f-8423f05f27cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:53.652682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ec63cebe-1554-41d1-aa7f-8423f05f27cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:53.653127 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ec63cebe-1554-41d1-aa7f-8423f05f27cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:53.653885 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ec63cebe-1554-41d1-aa7f-8423f05f27cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:53.654310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ec63cebe-1554-41d1-aa7f-8423f05f27cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:53.797328 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ec63cebe-1554-41d1-aa7f-8423f05f27cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:53.805277 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ec63cebe-1554-41d1-aa7f-8423f05f27cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.169495 Jul 12 13:20:53.805913 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 404/797] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:53 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:53.852415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:53.852990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:53.860228 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:53.860673 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:53.861432 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:53.861862 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:53.994909 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:54.003362 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:54.004847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:54.005992 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8df7a79e-e43b-4389-9a12-20a541aa68c6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.157545 Jul 12 13:20:54.006557 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 394/798] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:53 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:54.822910 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-457f82f5-ef4d-45bf-b194-bd7696d2d6f7 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:54.823583 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-457f82f5-ef4d-45bf-b194-bd7696d2d6f7 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:54.830697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-457f82f5-ef4d-45bf-b194-bd7696d2d6f7 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:54.831177 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-457f82f5-ef4d-45bf-b194-bd7696d2d6f7 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:54.831933 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-457f82f5-ef4d-45bf-b194-bd7696d2d6f7 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:54.832359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-457f82f5-ef4d-45bf-b194-bd7696d2d6f7 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:54.972318 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-457f82f5-ef4d-45bf-b194-bd7696d2d6f7 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:54.984147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-457f82f5-ef4d-45bf-b194-bd7696d2d6f7 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1569 microversion: 2.1 time: 0.165166 Jul 12 13:20:54.994329 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 405/799] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:54 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:55.024448 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:55.025114 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:55.031486 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:55.031920 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:55.032664 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:55.033169 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:55.172499 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:55.180400 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:55.182106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:55.183254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e1edc0fa-0664-493f-9b9c-e047e19f8472 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.162867 Jul 12 13:20:55.183803 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 395/800] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:55 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:56.004647 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c85cf8f3-c9bf-4075-9337-2ea8d517b002 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:56.005242 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c85cf8f3-c9bf-4075-9337-2ea8d517b002 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:56.016149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c85cf8f3-c9bf-4075-9337-2ea8d517b002 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:56.016762 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c85cf8f3-c9bf-4075-9337-2ea8d517b002 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:56.017851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c85cf8f3-c9bf-4075-9337-2ea8d517b002 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:56.018544 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c85cf8f3-c9bf-4075-9337-2ea8d517b002 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:56.159001 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c85cf8f3-c9bf-4075-9337-2ea8d517b002 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:56.167957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c85cf8f3-c9bf-4075-9337-2ea8d517b002 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1556 microversion: 2.1 time: 0.169831 Jul 12 13:20:56.171203 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 406/801] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:55 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:56.202606 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:56.203325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:56.210059 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:56.210564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:56.211489 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:56.212073 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:56.348195 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:56.358265 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:56.359827 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:56.360971 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-80933a39-49fd-4367-930a-e4f64783ef0a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1745 microversion: 2.20 time: 0.162218 Jul 12 13:20:56.361515 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 396/802] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:56 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:57.379655 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:57.380262 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:57.387120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:57.387568 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:57.388331 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:57.388757 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:57.527896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-116eae77-386c-4de9-b693-8e76dc11cc50 req-2fd33fb4-ff18-43fa-aa45-68f9ac354b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc", "name": "network-vif-plugged", "status": "completed", "tag": "b51df1af-aa43-43ff-b70a-c0a6ec76b42b"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:20:57.535080 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:57.540428 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-116eae77-386c-4de9-b693-8e76dc11cc50 req-2fd33fb4-ff18-43fa-aa45-68f9ac354b42 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:57.541071 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-116eae77-386c-4de9-b693-8e76dc11cc50 req-2fd33fb4-ff18-43fa-aa45-68f9ac354b42 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:57.547399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:57.549017 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:57.550494 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-650fa179-c306-465a-9d97-0b18246c79d0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1745 microversion: 2.20 time: 0.174807 Jul 12 13:20:57.551435 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 407/803] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:57 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:20:57.715946 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-116eae77-386c-4de9-b693-8e76dc11cc50 req-2fd33fb4-ff18-43fa-aa45-68f9ac354b42 service nova] Creating event network-vif-plugged:b51df1af-aa43-43ff-b70a-c0a6ec76b42b for instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc on hv-cinder-79760 Jul 12 13:20:57.721353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-116eae77-386c-4de9-b693-8e76dc11cc50 req-2fd33fb4-ff18-43fa-aa45-68f9ac354b42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197153 Jul 12 13:20:57.722033 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 397/804] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:20:58.569654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:58.570748 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:58.577317 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:58.578173 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:58.579043 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:58.579483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:58.752385 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:58.777971 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:58.779501 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:58.780672 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a7bbc178-fec6-4056-b5d2-2415caaed6cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.215788 Jul 12 13:20:58.782856 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 408/805] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:58 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:20:58.900581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5a91a144-1814-49c5-9b80-c9f5430401a1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:58.901274 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5a91a144-1814-49c5-9b80-c9f5430401a1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:58.908410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5a91a144-1814-49c5-9b80-c9f5430401a1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:58.909089 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5a91a144-1814-49c5-9b80-c9f5430401a1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:58.909857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5a91a144-1814-49c5-9b80-c9f5430401a1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:58.910279 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-5a91a144-1814-49c5-9b80-c9f5430401a1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:58.940105 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5a91a144-1814-49c5-9b80-c9f5430401a1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:20:58.943839 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=100 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:59.052275 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5a91a144-1814-49c5-9b80-c9f5430401a1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "DELETE /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 204 len: 0 microversion: 2.1 time: 0.156915 Jul 12 13:20:59.056869 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 398/806] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:20:58 2022] DELETE /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:20:59.062598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-76d981f4-3ff9-47f0-8071-c1fdea26ea89 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:59.063333 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-76d981f4-3ff9-47f0-8071-c1fdea26ea89 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:59.072809 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-76d981f4-3ff9-47f0-8071-c1fdea26ea89 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:59.073183 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-76d981f4-3ff9-47f0-8071-c1fdea26ea89 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:59.076252 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-76d981f4-3ff9-47f0-8071-c1fdea26ea89 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:59.076771 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-76d981f4-3ff9-47f0-8071-c1fdea26ea89 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:59.310637 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-76d981f4-3ff9-47f0-8071-c1fdea26ea89 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:20:59.319939 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-76d981f4-3ff9-47f0-8071-c1fdea26ea89 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1577 microversion: 2.1 time: 0.261703 Jul 12 13:20:59.321401 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 409/807] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:20:59 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1577 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:20:59.801990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:20:59.803107 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:20:59.806333 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:20:59.811542 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:59.812319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:59.813257 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:20:59.813878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:20:59.989641 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:00.007473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:00.009065 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:00.013821 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fdc789ae-1fb7-4cc2-82da-9c279aa9f91e tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.216697 Jul 12 13:21:00.015019 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 399/808] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:20:59 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:00.337639 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2fc722bd-1938-4150-ad5c-9d63066bce17 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:00.338245 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2fc722bd-1938-4150-ad5c-9d63066bce17 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:00.347929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fc722bd-1938-4150-ad5c-9d63066bce17 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:00.348915 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fc722bd-1938-4150-ad5c-9d63066bce17 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:00.349964 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fc722bd-1938-4150-ad5c-9d63066bce17 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:00.350390 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2fc722bd-1938-4150-ad5c-9d63066bce17 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:00.525063 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2fc722bd-1938-4150-ad5c-9d63066bce17 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:00.537410 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2fc722bd-1938-4150-ad5c-9d63066bce17 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1577 microversion: 2.1 time: 0.203572 Jul 12 13:21:00.549613 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 410/809] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:00 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:01.051599 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:01.052257 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:01.061143 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:01.061585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:01.064646 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:01.065106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:01.398413 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:01.407790 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:01.409283 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:01.410453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-46e493f4-2dec-4220-a7ec-6cc60c01ff0c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.380934 Jul 12 13:21:01.414011 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 400/810] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:01 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:01.556523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ab201865-10a1-48dc-b580-9ec29ff34da0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:01.557130 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ab201865-10a1-48dc-b580-9ec29ff34da0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:01.567548 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ab201865-10a1-48dc-b580-9ec29ff34da0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:01.567989 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ab201865-10a1-48dc-b580-9ec29ff34da0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:01.570065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ab201865-10a1-48dc-b580-9ec29ff34da0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:01.570732 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ab201865-10a1-48dc-b580-9ec29ff34da0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:01.740645 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ab201865-10a1-48dc-b580-9ec29ff34da0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:01.764453 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ab201865-10a1-48dc-b580-9ec29ff34da0 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1577 microversion: 2.1 time: 0.211736 Jul 12 13:21:01.768029 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 411/811] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:01 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:02.143134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-f0c1fb0c-aabe-488f-a8fc-bc182c6bc4fe req-6925a50d-3fc2-4c70-81ee-8ee75022ff2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8", "name": "network-vif-deleted", "tag": "3c2279a3-7680-4337-9967-279c4c885c20"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:02.186245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f0c1fb0c-aabe-488f-a8fc-bc182c6bc4fe req-6925a50d-3fc2-4c70-81ee-8ee75022ff2d service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:02.187835 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f0c1fb0c-aabe-488f-a8fc-bc182c6bc4fe req-6925a50d-3fc2-4c70-81ee-8ee75022ff2d service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:02.231307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-f0c1fb0c-aabe-488f-a8fc-bc182c6bc4fe req-6925a50d-3fc2-4c70-81ee-8ee75022ff2d service nova] Creating event network-vif-deleted:3c2279a3-7680-4337-9967-279c4c885c20 for instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 on hv-cinder-79760 Jul 12 13:21:02.236545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-f0c1fb0c-aabe-488f-a8fc-bc182c6bc4fe req-6925a50d-3fc2-4c70-81ee-8ee75022ff2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097383 Jul 12 13:21:02.237825 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 401/812] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:21:02.429134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:02.432389 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:02.440508 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:02.440875 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:02.441659 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:02.442089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:02.722037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:02.743484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:02.747563 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:02.748828 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8232c50b-0af0-4ad2-8da5-3d748b3f219f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.323768 Jul 12 13:21:02.749392 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 412/813] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:02 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:02.784658 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:02.787219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:02.806294 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:02.806741 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:02.807707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:02.808242 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:02.849934 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:02.850456 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:02.850903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lazy-loading 'fault' on Instance uuid 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:21:02.917392 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:02.927890 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-14398efa-380c-4d78-b61e-c6f8a5632b98 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 200 len: 1230 microversion: 2.1 time: 0.147345 Jul 12 13:21:02.939294 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 402/814] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:02 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 1230 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:03.768002 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:03.768763 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:03.775640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:03.776085 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:03.776848 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:03.777454 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:03.931217 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:03.945693 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:03.947892 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:03.957118 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:03.958980 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:03.960556 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:03.961094 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:03.962358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-21c1f7e3-1bbd-4217-ab09-7193593af278 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.199125 Jul 12 13:21:03.963298 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:03.963822 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:03.981486 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 413/815] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:03 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:21:03.991847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] HTTP exception thrown: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Request method failure captured: Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 HTTP/1.1 Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXR5NCdXXNYSzvnx9inA8_Kqvob1_StVXiy1nnhtTqqRgucZV6grzk2fdeRVQBh_hKD9aE-QGWR2T7f_LYwmCN8JF8v9h_KcJ_3Mo8P2ww7Pjh3byFEMjuDDXTu7tyA7q9cp2eb_xA81UkYaAfuY2RC5DA4HmC3mLEZR7YS5YXFeTrM Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:21:03.994877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-TestVolumeBootPattern-622949544 Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 0d6f70302739437b8d14fc0fd7967dac Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:21:03.996415 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8'} Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:03.997258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:21:03.998585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:03.999765 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Returning 404 to user: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:03.999765 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bafbf4e3-aaab-4be0-bb5e-365699e815f2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 404 len: 111 microversion: 2.1 time: 0.054708 Jul 12 13:21:03.999765 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 403/816] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:03 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:21:04.108466 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1081045762", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1629722949", "security_groups": [{"name": "tempest-secgroup-smoke-683362428"}], "block_device_mapping_v2": [{"uuid": "76e44206-8630-42e6-b6c0-d9f1656c9011", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "04848669-0add-4a7f-9670-bf6780611a41"}]}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:04.255844 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] validate_networks() for [('04848669-0add-4a7f-9670-bf6780611a41', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:21:04.488072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:04.722616 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:21:04.723316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:21:04.724079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:21:04.724580 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:21:04.725548 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:21:04.738621 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:04.739230 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:04.740286 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:04.740933 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:04.748503 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=100 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:04.765256 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Getting quotas for project e603fb53b07e43a2b529f59a02f687fc. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:21:04.774770 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Getting quotas for user 0d6f70302739437b8d14fc0fd7967dac and project e603fb53b07e43a2b529f59a02f687fc. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:21:04.869500 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:21:04.872973 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76e44206-8630-42e6-b6c0-d9f1656c9011',volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:21:04.997969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:04.997969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:05.019866 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:05.020325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:05.021115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:05.021517 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:05.116932 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ec8e47f7-25d6-4f34-a563-7c9896f0b488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.015795 Jul 12 13:21:05.117727 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 414/817] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:21:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:21:05.130210 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c4644841-82a9-422e-9043-9913f7278289 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:05.130824 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c4644841-82a9-422e-9043-9913f7278289 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:05.250375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c4644841-82a9-422e-9043-9913f7278289 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:05.260682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c4644841-82a9-422e-9043-9913f7278289 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1095 microversion: 2.1 time: 0.134389 Jul 12 13:21:05.263718 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 415/818] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:05 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1095 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:05.288794 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:05.298258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:05.300788 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:05.302265 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-86d63809-2407-43be-a297-8395a36680c8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.320716 Jul 12 13:21:05.303402 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 404/819] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:04 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:06.280554 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ef935599-4978-4c4e-8a27-94caa4136c7d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:06.281876 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ef935599-4978-4c4e-8a27-94caa4136c7d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:06.309089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ef935599-4978-4c4e-8a27-94caa4136c7d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:06.311497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ef935599-4978-4c4e-8a27-94caa4136c7d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:06.312449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ef935599-4978-4c4e-8a27-94caa4136c7d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:06.323179 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:06.325094 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:06.330372 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ef935599-4978-4c4e-8a27-94caa4136c7d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:06.333867 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:06.335658 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:06.336818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:06.337460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:06.487293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ef935599-4978-4c4e-8a27-94caa4136c7d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:06.502558 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:06.502976 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ef935599-4978-4c4e-8a27-94caa4136c7d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1193 microversion: 2.1 time: 0.226355 Jul 12 13:21:06.504555 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 416/820] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:06 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1193 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:06.511144 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:06.514484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:06.525898 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-040c1a45-b87e-495b-a2ca-a475a3371797 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.206483 Jul 12 13:21:06.526588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 405/821] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:06 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:07.522145 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-826a545b-8ea7-4763-a12d-9b24ef117c96 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:07.522756 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-826a545b-8ea7-4763-a12d-9b24ef117c96 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:07.537065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-826a545b-8ea7-4763-a12d-9b24ef117c96 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:07.537518 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-826a545b-8ea7-4763-a12d-9b24ef117c96 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:07.538782 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-826a545b-8ea7-4763-a12d-9b24ef117c96 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:07.539394 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-826a545b-8ea7-4763-a12d-9b24ef117c96 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:07.546743 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:07.547608 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:07.571405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:07.572489 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:07.574274 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:07.575377 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:07.838673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-826a545b-8ea7-4763-a12d-9b24ef117c96 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:07.869917 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-826a545b-8ea7-4763-a12d-9b24ef117c96 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1278 microversion: 2.1 time: 0.348891 Jul 12 13:21:07.872604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 417/822] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:07 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1278 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:07.990108 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:08.005467 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:08.007435 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:08.008650 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-eb5c28b3-5846-4e27-aed2-67c7432820b0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.466455 Jul 12 13:21:08.009205 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 406/823] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:07 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:21:08.888635 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5fcd63d0-8bfd-4f3d-a58f-130ebab2ec12 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:08.889261 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-5fcd63d0-8bfd-4f3d-a58f-130ebab2ec12 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:08.900146 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5fcd63d0-8bfd-4f3d-a58f-130ebab2ec12 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:08.903529 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5fcd63d0-8bfd-4f3d-a58f-130ebab2ec12 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:08.904325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5fcd63d0-8bfd-4f3d-a58f-130ebab2ec12 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:08.904763 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5fcd63d0-8bfd-4f3d-a58f-130ebab2ec12 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:08.993638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-57e898db-8a08-4c76-a7c9-a408becdc24a req-1820ab29-9d73-42b0-aa3d-fbd10e5faef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb9c528-38ad-4408-bb80-7dd426dbe142", "tag": "d140b555-5d1b-4434-853f-5cfc8f27c57e"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:09.034612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-57e898db-8a08-4c76-a7c9-a408becdc24a req-1820ab29-9d73-42b0-aa3d-fbd10e5faef9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:09.036091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-57e898db-8a08-4c76-a7c9-a408becdc24a req-1820ab29-9d73-42b0-aa3d-fbd10e5faef9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:09.074690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-57e898db-8a08-4c76-a7c9-a408becdc24a req-1820ab29-9d73-42b0-aa3d-fbd10e5faef9 service nova] Creating event network-changed:d140b555-5d1b-4434-853f-5cfc8f27c57e for instance bcb9c528-38ad-4408-bb80-7dd426dbe142 on hv-cinder-79760 Jul 12 13:21:09.086070 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-57e898db-8a08-4c76-a7c9-a408becdc24a req-1820ab29-9d73-42b0-aa3d-fbd10e5faef9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101635 Jul 12 13:21:09.095472 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 407/824] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:21:09.109774 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:09.113222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:09.133095 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:09.134349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:09.136113 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:09.137406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:09.194006 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5fcd63d0-8bfd-4f3d-a58f-130ebab2ec12 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:09.218771 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5fcd63d0-8bfd-4f3d-a58f-130ebab2ec12 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.334188 Jul 12 13:21:09.223011 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 418/825] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:08 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:09.230051 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f9afdfcb-2e0a-4b66-ae4c-1748b1cb5c6f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:09.231788 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f9afdfcb-2e0a-4b66-ae4c-1748b1cb5c6f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:09.248918 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f9afdfcb-2e0a-4b66-ae4c-1748b1cb5c6f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:09.249655 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f9afdfcb-2e0a-4b66-ae4c-1748b1cb5c6f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:09.257879 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f9afdfcb-2e0a-4b66-ae4c-1748b1cb5c6f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:09.258579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f9afdfcb-2e0a-4b66-ae4c-1748b1cb5c6f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:09.395801 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f9afdfcb-2e0a-4b66-ae4c-1748b1cb5c6f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "POST /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/action" status: 202 len: 0 microversion: 2.1 time: 0.170784 Jul 12 13:21:09.400112 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 419/826] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:21:09 2022] POST /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:21:09.412446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e0cb072d-b83e-4699-ac0a-bdce9194c077 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:09.413156 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e0cb072d-b83e-4699-ac0a-bdce9194c077 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:09.420530 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0cb072d-b83e-4699-ac0a-bdce9194c077 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:09.421294 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0cb072d-b83e-4699-ac0a-bdce9194c077 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:09.422200 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0cb072d-b83e-4699-ac0a-bdce9194c077 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:09.422863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0cb072d-b83e-4699-ac0a-bdce9194c077 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:09.554348 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:09.564797 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:09.567982 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:09.571070 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-286f81f8-4390-4d6c-b1e5-311c51798f72 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.468661 Jul 12 13:21:09.572111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 408/827] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:09 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:09.612298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e0cb072d-b83e-4699-ac0a-bdce9194c077 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:09.621831 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e0cb072d-b83e-4699-ac0a-bdce9194c077 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1750 microversion: 2.1 time: 0.214371 Jul 12 13:21:09.634392 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 420/828] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:09 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1750 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:10.236676 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a5c4cc6e-064f-4c3e-a685-a36ce8769785 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:10.237282 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a5c4cc6e-064f-4c3e-a685-a36ce8769785 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:10.244116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc6e-064f-4c3e-a685-a36ce8769785 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:10.244704 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc6e-064f-4c3e-a685-a36ce8769785 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:10.245478 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc6e-064f-4c3e-a685-a36ce8769785 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:10.246250 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc6e-064f-4c3e-a685-a36ce8769785 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:10.588845 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:10.589793 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:10.597363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:10.597819 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:10.598633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:10.599093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:10.747910 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:10.755877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a5c4cc6e-064f-4c3e-a685-a36ce8769785 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:10.757907 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:10.759879 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:10.760640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b564bb2d-290c-418c-9a62-d45d8613044a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1740 microversion: 2.20 time: 0.175824 Jul 12 13:21:10.761193 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 421/829] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:10 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:10.770670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-48e3e95e-d42f-4766-bde5-102259479a48 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:10.770874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a5c4cc6e-064f-4c3e-a685-a36ce8769785 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.538050 Jul 12 13:21:10.771806 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 409/830] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:10 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:10.772150 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-48e3e95e-d42f-4766-bde5-102259479a48 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:10.778643 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-48e3e95e-d42f-4766-bde5-102259479a48 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:10.779120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-48e3e95e-d42f-4766-bde5-102259479a48 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:10.779898 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-48e3e95e-d42f-4766-bde5-102259479a48 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:10.780528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-48e3e95e-d42f-4766-bde5-102259479a48 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:10.933466 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-48e3e95e-d42f-4766-bde5-102259479a48 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:10.945227 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-48e3e95e-d42f-4766-bde5-102259479a48 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1750 microversion: 2.1 time: 0.182376 Jul 12 13:21:10.945961 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 422/831] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:10 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:11.779950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:11.780607 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:11.787326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:11.787751 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:11.788618 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7b8c54b2-e285-4ba7-939e-7abe37216092 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:11.789186 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:11.789307 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7b8c54b2-e285-4ba7-939e-7abe37216092 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:11.789881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:11.796370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b8c54b2-e285-4ba7-939e-7abe37216092 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:11.796829 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b8c54b2-e285-4ba7-939e-7abe37216092 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:11.797898 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b8c54b2-e285-4ba7-939e-7abe37216092 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:11.798649 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b8c54b2-e285-4ba7-939e-7abe37216092 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:11.951512 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:11.962728 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:11.964618 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:11.966296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c9ed113e-6b7d-4e86-8315-d0e1c58e3bca tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1722 microversion: 2.20 time: 0.190356 Jul 12 13:21:11.967198 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 410/832] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:11 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:11.971884 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0e6335cc-14d4-43d2-bbc9-e828c76c58e9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:11.972710 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0e6335cc-14d4-43d2-bbc9-e828c76c58e9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:11.973354 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7b8c54b2-e285-4ba7-939e-7abe37216092 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:11.980452 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e6335cc-14d4-43d2-bbc9-e828c76c58e9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:11.981324 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e6335cc-14d4-43d2-bbc9-e828c76c58e9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:11.982357 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e6335cc-14d4-43d2-bbc9-e828c76c58e9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:11.982773 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7b8c54b2-e285-4ba7-939e-7abe37216092 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.199103 Jul 12 13:21:11.982893 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e6335cc-14d4-43d2-bbc9-e828c76c58e9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:11.983652 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 423/833] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:11 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:12.148364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0e6335cc-14d4-43d2-bbc9-e828c76c58e9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:12.160283 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0e6335cc-14d4-43d2-bbc9-e828c76c58e9 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.191850 Jul 12 13:21:12.161045 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 411/834] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:11 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:12.990152 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:12.991153 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:13.002446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:13.003238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:13.003944 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dfe9e9cb-6a4f-4b10-a30c-a4f98b5104ba tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:13.004661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:13.004937 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dfe9e9cb-6a4f-4b10-a30c-a4f98b5104ba tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:13.005176 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:13.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfe9e9cb-6a4f-4b10-a30c-a4f98b5104ba tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:13.014826 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfe9e9cb-6a4f-4b10-a30c-a4f98b5104ba tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:13.015620 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfe9e9cb-6a4f-4b10-a30c-a4f98b5104ba tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:13.016049 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dfe9e9cb-6a4f-4b10-a30c-a4f98b5104ba tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:13.154987 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:13.160621 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dfe9e9cb-6a4f-4b10-a30c-a4f98b5104ba tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:13.163790 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:13.165279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:13.166449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8901238a-2617-485c-ae5f-ad68f11cc96c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1722 microversion: 2.20 time: 0.182854 Jul 12 13:21:13.168815 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 424/835] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:12 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:13.169347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dfe9e9cb-6a4f-4b10-a30c-a4f98b5104ba tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.171716 Jul 12 13:21:13.169925 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 412/836] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:12 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:13.183642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b597ae5d-6f7d-40a8-9112-9f704b107306 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:13.184325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b597ae5d-6f7d-40a8-9112-9f704b107306 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:13.191297 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b597ae5d-6f7d-40a8-9112-9f704b107306 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:13.191734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b597ae5d-6f7d-40a8-9112-9f704b107306 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:13.192482 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b597ae5d-6f7d-40a8-9112-9f704b107306 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:13.192904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b597ae5d-6f7d-40a8-9112-9f704b107306 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:13.340510 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b597ae5d-6f7d-40a8-9112-9f704b107306 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:13.348766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b597ae5d-6f7d-40a8-9112-9f704b107306 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.169559 Jul 12 13:21:13.349407 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 425/837] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:13 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:14.187308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ba250593-e8bf-4035-bb86-d40cf1c660f6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:14.188041 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ba250593-e8bf-4035-bb86-d40cf1c660f6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:14.192717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:14.193321 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:14.203751 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.204083 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ba250593-e8bf-4035-bb86-d40cf1c660f6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.204459 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.204574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ba250593-e8bf-4035-bb86-d40cf1c660f6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.205226 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.205527 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ba250593-e8bf-4035-bb86-d40cf1c660f6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.205639 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.205965 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ba250593-e8bf-4035-bb86-d40cf1c660f6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.343115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:14.351291 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:14.352975 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:14.354228 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b2b755b5-3209-4dcc-a059-b8f9cea9c985 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1665 microversion: 2.20 time: 0.173493 Jul 12 13:21:14.354796 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 413/838] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:14 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1665 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:14.365772 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a785b67a-073e-4e6a-a6d1-bcf7d5782eb4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:14.366495 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a785b67a-073e-4e6a-a6d1-bcf7d5782eb4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:14.374533 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a785b67a-073e-4e6a-a6d1-bcf7d5782eb4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.375143 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a785b67a-073e-4e6a-a6d1-bcf7d5782eb4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.376168 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a785b67a-073e-4e6a-a6d1-bcf7d5782eb4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.377666 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a785b67a-073e-4e6a-a6d1-bcf7d5782eb4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.419992 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ba250593-e8bf-4035-bb86-d40cf1c660f6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:14.428283 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ba250593-e8bf-4035-bb86-d40cf1c660f6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.245705 Jul 12 13:21:14.428873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 426/839] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:14 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:14.434590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f5323733-6947-459f-8fb5-f05092cd6fb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d8b096d-e269-4729-9b69-c672c1b49433"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:14.435732 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f5323733-6947-459f-8fb5-f05092cd6fb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:14.442341 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f5323733-6947-459f-8fb5-f05092cd6fb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.443120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f5323733-6947-459f-8fb5-f05092cd6fb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.444089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f5323733-6947-459f-8fb5-f05092cd6fb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.444555 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f5323733-6947-459f-8fb5-f05092cd6fb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.547382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a785b67a-073e-4e6a-a6d1-bcf7d5782eb4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:14.557029 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a785b67a-073e-4e6a-a6d1-bcf7d5782eb4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.194920 Jul 12 13:21:14.568489 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 414/840] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:14 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:14.749408 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:14.779363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f5323733-6947-459f-8fb5-f05092cd6fb0 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.348627 Jul 12 13:21:14.779975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 427/841] 10.222.0.33 () {62 vars in 1363 bytes} [Tue Jul 12 13:21:14 2022] POST /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/os-volume_attachments => generated 188 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:21:14.897618 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1b249ac2-e068-45dd-b8aa-0b92bd726c04 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:14.898126 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1b249ac2-e068-45dd-b8aa-0b92bd726c04 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:14.904944 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b249ac2-e068-45dd-b8aa-0b92bd726c04 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.905412 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b249ac2-e068-45dd-b8aa-0b92bd726c04 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.906188 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b249ac2-e068-45dd-b8aa-0b92bd726c04 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:14.906555 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b249ac2-e068-45dd-b8aa-0b92bd726c04 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:14.925747 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:15.192796 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1b249ac2-e068-45dd-b8aa-0b92bd726c04 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/os-volume_attachments/2d8b096d-e269-4729-9b69-c672c1b49433" status: 202 len: 0 microversion: 2.20 time: 0.299176 Jul 12 13:21:15.193671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 415/842] 10.222.0.33 () {60 vars in 1456 bytes} [Tue Jul 12 13:21:14 2022] DELETE /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/os-volume_attachments/2d8b096d-e269-4729-9b69-c672c1b49433 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 13:21:15.251351 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-181047a6-99fd-4b20-b89a-b789cdf134b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:15.251926 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-181047a6-99fd-4b20-b89a-b789cdf134b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:15.257105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=8 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:15.258980 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-181047a6-99fd-4b20-b89a-b789cdf134b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:15.259460 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-181047a6-99fd-4b20-b89a-b789cdf134b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:15.260208 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-181047a6-99fd-4b20-b89a-b789cdf134b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:15.260631 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-181047a6-99fd-4b20-b89a-b789cdf134b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:15.295610 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:15.347755 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-181047a6-99fd-4b20-b89a-b789cdf134b6 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "POST /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/action" status: 202 len: 0 microversion: 2.20 time: 0.099896 Jul 12 13:21:15.348566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 428/843] 10.222.0.33 () {62 vars in 1318 bytes} [Tue Jul 12 13:21:15 2022] POST /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:21:15.356613 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:15.357859 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:15.367258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:15.367706 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:15.368656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:15.369227 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:15.446285 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-74c91d7b-a726-4a2c-9693-c2871c206604 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:15.446889 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-74c91d7b-a726-4a2c-9693-c2871c206604 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:15.454904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74c91d7b-a726-4a2c-9693-c2871c206604 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:15.455546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74c91d7b-a726-4a2c-9693-c2871c206604 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:15.456488 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74c91d7b-a726-4a2c-9693-c2871c206604 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:15.457109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-74c91d7b-a726-4a2c-9693-c2871c206604 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:15.576948 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:15.585738 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:15.587308 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:15.588400 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4528ddee-01da-4f26-ba3d-6f07df458f00 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1673 microversion: 2.20 time: 0.236040 Jul 12 13:21:15.588954 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 416/844] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:15 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:21:15.616148 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-24c6dcda-2f90-43bf-9f0e-63c58fe2ea0b tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:15.616791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-24c6dcda-2f90-43bf-9f0e-63c58fe2ea0b tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:15.629074 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24c6dcda-2f90-43bf-9f0e-63c58fe2ea0b tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:15.629514 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24c6dcda-2f90-43bf-9f0e-63c58fe2ea0b tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:15.639614 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24c6dcda-2f90-43bf-9f0e-63c58fe2ea0b tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:15.640100 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24c6dcda-2f90-43bf-9f0e-63c58fe2ea0b tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:15.821159 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-24c6dcda-2f90-43bf-9f0e-63c58fe2ea0b tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:15.833029 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-24c6dcda-2f90-43bf-9f0e-63c58fe2ea0b tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.222191 Jul 12 13:21:15.834079 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 417/845] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:15 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:15.839739 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-c0201407-12ea-44f5-a0ad-8857605278e6 req-b3a86950-d280-441a-ab26-c44c0a9e2002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc", "name": "network-vif-unplugged", "status": "completed", "tag": "b51df1af-aa43-43ff-b70a-c0a6ec76b42b"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:15.850812 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-c0201407-12ea-44f5-a0ad-8857605278e6 req-b3a86950-d280-441a-ab26-c44c0a9e2002 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:15.851353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-c0201407-12ea-44f5-a0ad-8857605278e6 req-b3a86950-d280-441a-ab26-c44c0a9e2002 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:15.871484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.compute.server_external_events [req-c0201407-12ea-44f5-a0ad-8857605278e6 req-b3a86950-d280-441a-ab26-c44c0a9e2002 service nova] Unable to find a host for instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc. Dropping event network-vif-unplugged {{(pid=117963) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 13:21:15.872388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-c0201407-12ea-44f5-a0ad-8857605278e6 req-b3a86950-d280-441a-ab26-c44c0a9e2002 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036914 Jul 12 13:21:15.873344 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 418/846] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 13:21:15.877189 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-74c91d7b-a726-4a2c-9693-c2871c206604 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:15.885522 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-74c91d7b-a726-4a2c-9693-c2871c206604 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.443953 Jul 12 13:21:15.886934 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 429/847] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:15 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:16.607119 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:16.607728 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:16.616234 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:16.617258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:16.619840 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:16.620502 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:16.779204 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:16.787344 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:16.788844 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:16.790038 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2c281b60-c06b-4a21-8e8a-4cf38c3d1127 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1675 microversion: 2.20 time: 0.187141 Jul 12 13:21:16.798152 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 419/848] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:16 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:16.850410 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fd31a837-ff32-464f-bf0b-da6b7baa22c5 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:16.851035 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fd31a837-ff32-464f-bf0b-da6b7baa22c5 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:16.857684 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fd31a837-ff32-464f-bf0b-da6b7baa22c5 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:16.858123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fd31a837-ff32-464f-bf0b-da6b7baa22c5 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:16.858872 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fd31a837-ff32-464f-bf0b-da6b7baa22c5 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:16.859427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fd31a837-ff32-464f-bf0b-da6b7baa22c5 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:16.902037 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e33422cd-c6b3-4eb3-b636-61be86d61934 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:16.902699 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e33422cd-c6b3-4eb3-b636-61be86d61934 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:16.908993 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e33422cd-c6b3-4eb3-b636-61be86d61934 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:16.909423 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e33422cd-c6b3-4eb3-b636-61be86d61934 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:16.911186 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e33422cd-c6b3-4eb3-b636-61be86d61934 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:16.911343 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e33422cd-c6b3-4eb3-b636-61be86d61934 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:17.052856 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fd31a837-ff32-464f-bf0b-da6b7baa22c5 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:17.065077 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fd31a837-ff32-464f-bf0b-da6b7baa22c5 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.216856 Jul 12 13:21:17.066313 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 430/849] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:16 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:17.088802 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e33422cd-c6b3-4eb3-b636-61be86d61934 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:17.098497 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e33422cd-c6b3-4eb3-b636-61be86d61934 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.200173 Jul 12 13:21:17.099290 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 420/850] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:16 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:17.809325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:17.809923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:17.816223 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:17.816646 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:17.817398 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:17.817823 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:18.014975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:18.028744 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:18.030684 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:18.031874 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2d55789c-bd64-4bf4-a2c6-554dbfb33f2b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.226621 Jul 12 13:21:18.032419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 431/851] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:17 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:18.082798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8376407b-5b7e-496d-a46f-d5727d12fa19 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:18.083390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8376407b-5b7e-496d-a46f-d5727d12fa19 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:18.091376 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8376407b-5b7e-496d-a46f-d5727d12fa19 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:18.092026 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8376407b-5b7e-496d-a46f-d5727d12fa19 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:18.092962 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8376407b-5b7e-496d-a46f-d5727d12fa19 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:18.093385 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8376407b-5b7e-496d-a46f-d5727d12fa19 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:18.118916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b09bf5e2-7825-4a76-b9b2-a8c7cc9d6ede tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:18.119928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-b09bf5e2-7825-4a76-b9b2-a8c7cc9d6ede tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:18.130862 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b09bf5e2-7825-4a76-b9b2-a8c7cc9d6ede tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:18.132432 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b09bf5e2-7825-4a76-b9b2-a8c7cc9d6ede tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:18.133483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b09bf5e2-7825-4a76-b9b2-a8c7cc9d6ede tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:18.134104 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-b09bf5e2-7825-4a76-b9b2-a8c7cc9d6ede tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:18.305584 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8376407b-5b7e-496d-a46f-d5727d12fa19 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:18.315895 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8376407b-5b7e-496d-a46f-d5727d12fa19 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.237430 Jul 12 13:21:18.316471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 421/852] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:18 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:18.342916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-b09bf5e2-7825-4a76-b9b2-a8c7cc9d6ede tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:18.356483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b09bf5e2-7825-4a76-b9b2-a8c7cc9d6ede tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.244484 Jul 12 13:21:18.357059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 432/853] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:18 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:19.054015 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:19.055330 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:19.063401 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:19.064112 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:19.065313 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:19.066118 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:19.314229 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:19.330375 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:19.332719 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:19.334166 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-14830db9-9a42-4852-9317-7a5e4428dd90 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.285456 Jul 12 13:21:19.334935 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-47b5c089-abd6-4d46-a8de-20ad7ae945d1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:19.346032 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 422/854] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:19 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:19.348122 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-47b5c089-abd6-4d46-a8de-20ad7ae945d1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:19.355363 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-47b5c089-abd6-4d46-a8de-20ad7ae945d1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:19.356213 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-47b5c089-abd6-4d46-a8de-20ad7ae945d1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:19.357186 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-47b5c089-abd6-4d46-a8de-20ad7ae945d1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:19.357800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-47b5c089-abd6-4d46-a8de-20ad7ae945d1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:19.374258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2a496a56-6567-47fc-b5cc-42234a9620c3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:19.374885 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2a496a56-6567-47fc-b5cc-42234a9620c3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:19.382797 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a496a56-6567-47fc-b5cc-42234a9620c3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:19.383261 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a496a56-6567-47fc-b5cc-42234a9620c3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:19.384031 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a496a56-6567-47fc-b5cc-42234a9620c3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:19.384466 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a496a56-6567-47fc-b5cc-42234a9620c3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:19.622072 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2a496a56-6567-47fc-b5cc-42234a9620c3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:19.631253 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2a496a56-6567-47fc-b5cc-42234a9620c3 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.260844 Jul 12 13:21:19.633734 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 423/855] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:19 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:19.721054 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-47b5c089-abd6-4d46-a8de-20ad7ae945d1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:19.721938 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-dabc2fbc-2cf2-4e7e-ba02-16965044c112 req-6c03788a-0cf5-4aa5-922a-a8629fa35041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb9c528-38ad-4408-bb80-7dd426dbe142", "name": "network-vif-plugged", "status": "completed", "tag": "d140b555-5d1b-4434-853f-5cfc8f27c57e"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:19.737074 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-dabc2fbc-2cf2-4e7e-ba02-16965044c112 req-6c03788a-0cf5-4aa5-922a-a8629fa35041 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:19.737513 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-dabc2fbc-2cf2-4e7e-ba02-16965044c112 req-6c03788a-0cf5-4aa5-922a-a8629fa35041 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:19.742713 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-47b5c089-abd6-4d46-a8de-20ad7ae945d1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.412784 Jul 12 13:21:19.752916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 433/856] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:19 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:19.759053 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-dabc2fbc-2cf2-4e7e-ba02-16965044c112 req-6c03788a-0cf5-4aa5-922a-a8629fa35041 service nova] Creating event network-vif-plugged:d140b555-5d1b-4434-853f-5cfc8f27c57e for instance bcb9c528-38ad-4408-bb80-7dd426dbe142 on hv-cinder-79760 Jul 12 13:21:19.771156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-dabc2fbc-2cf2-4e7e-ba02-16965044c112 req-6c03788a-0cf5-4aa5-922a-a8629fa35041 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053330 Jul 12 13:21:19.772046 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 424/857] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:21:20.353864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:20.355672 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:20.363443 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:20.363978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:20.364978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:20.365845 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:20.528343 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:20.538049 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:20.539957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:20.541347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c750177a-bcef-4ad0-9f6b-070fe4062b50 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.191727 Jul 12 13:21:20.542805 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 434/858] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:20 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:20.654875 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1b7533d7-e9da-4806-acd9-e8626c34f6bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:20.655599 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-1b7533d7-e9da-4806-acd9-e8626c34f6bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:20.663376 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b7533d7-e9da-4806-acd9-e8626c34f6bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:20.664193 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b7533d7-e9da-4806-acd9-e8626c34f6bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:20.665140 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b7533d7-e9da-4806-acd9-e8626c34f6bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:20.665564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-1b7533d7-e9da-4806-acd9-e8626c34f6bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:20.763874 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-917e55f2-b444-4985-8049-8564e6e1305f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:20.764492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-917e55f2-b444-4985-8049-8564e6e1305f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:20.770748 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-917e55f2-b444-4985-8049-8564e6e1305f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:20.771342 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-917e55f2-b444-4985-8049-8564e6e1305f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:20.772100 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-917e55f2-b444-4985-8049-8564e6e1305f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:20.772525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-917e55f2-b444-4985-8049-8564e6e1305f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:20.811569 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-1b7533d7-e9da-4806-acd9-e8626c34f6bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:20.827295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1b7533d7-e9da-4806-acd9-e8626c34f6bf tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.177845 Jul 12 13:21:20.835310 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 425/859] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:20 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:20.965683 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-917e55f2-b444-4985-8049-8564e6e1305f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:20.974626 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-917e55f2-b444-4985-8049-8564e6e1305f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.214670 Jul 12 13:21:20.975504 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 435/860] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:20 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:21.562764 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:21.563834 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:21.571612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:21.572148 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:21.573005 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:21.573510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:21.743690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:21.752244 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:21.753913 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:21.755486 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4fa8c23e-6d3a-4707-9c73-a67295229ab4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.198296 Jul 12 13:21:21.756705 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 426/861] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:21 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:21.845746 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-50b879ff-c973-4221-ad70-863049d6a922 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:21.846414 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-50b879ff-c973-4221-ad70-863049d6a922 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:21.853394 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-50b879ff-c973-4221-ad70-863049d6a922 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:21.853947 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-50b879ff-c973-4221-ad70-863049d6a922 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:21.854721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-50b879ff-c973-4221-ad70-863049d6a922 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:21.855502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-50b879ff-c973-4221-ad70-863049d6a922 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:21.992703 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-03b2cea7-6ae0-42bc-89c9-0eb2caac8dac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:21.993621 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-03b2cea7-6ae0-42bc-89c9-0eb2caac8dac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:22.001007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-03b2cea7-6ae0-42bc-89c9-0eb2caac8dac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:22.001608 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-03b2cea7-6ae0-42bc-89c9-0eb2caac8dac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:22.002346 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-03b2cea7-6ae0-42bc-89c9-0eb2caac8dac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:22.002884 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-03b2cea7-6ae0-42bc-89c9-0eb2caac8dac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:22.060324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-50b879ff-c973-4221-ad70-863049d6a922 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:22.068259 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-50b879ff-c973-4221-ad70-863049d6a922 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.227038 Jul 12 13:21:22.078057 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 436/862] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:21 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:22.192711 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-03b2cea7-6ae0-42bc-89c9-0eb2caac8dac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:22.201566 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-03b2cea7-6ae0-42bc-89c9-0eb2caac8dac tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.213286 Jul 12 13:21:22.202397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 427/863] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:21 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:22.775492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:22.776129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:22.782981 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:22.783437 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:22.784195 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:22.784629 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:22.922880 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:22.934687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:22.937636 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:22.939350 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-44e5fc3b-b65d-4f6e-9041-6f9688119c85 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.167937 Jul 12 13:21:22.939919 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 437/864] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:22 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:23.090227 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2fb76ace-692e-4d6c-ba7d-7a4279edc946 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:23.091164 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2fb76ace-692e-4d6c-ba7d-7a4279edc946 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:23.098407 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fb76ace-692e-4d6c-ba7d-7a4279edc946 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:23.098984 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fb76ace-692e-4d6c-ba7d-7a4279edc946 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:23.099849 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fb76ace-692e-4d6c-ba7d-7a4279edc946 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:23.100345 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2fb76ace-692e-4d6c-ba7d-7a4279edc946 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:23.220031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-008eb4ad-732d-478a-b7e2-161ebef07f96 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:23.220631 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-008eb4ad-732d-478a-b7e2-161ebef07f96 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:23.234670 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-008eb4ad-732d-478a-b7e2-161ebef07f96 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:23.235365 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-008eb4ad-732d-478a-b7e2-161ebef07f96 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:23.236313 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-008eb4ad-732d-478a-b7e2-161ebef07f96 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:23.236893 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-008eb4ad-732d-478a-b7e2-161ebef07f96 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:23.266227 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2fb76ace-692e-4d6c-ba7d-7a4279edc946 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:23.274387 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2fb76ace-692e-4d6c-ba7d-7a4279edc946 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.188261 Jul 12 13:21:23.275012 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 428/865] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:23 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:23.398652 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-008eb4ad-732d-478a-b7e2-161ebef07f96 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:23.407202 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-008eb4ad-732d-478a-b7e2-161ebef07f96 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.190935 Jul 12 13:21:23.407753 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 438/866] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:23 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:23.957913 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:23.958509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:23.965411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:23.966388 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:23.968044 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:23.972119 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:24.118287 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:24.135204 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:24.137103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:24.138470 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0ccc8906-c320-4cd5-a509-03b093eea1bf tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.184673 Jul 12 13:21:24.139250 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 429/867] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:23 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:24.292796 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-35a882bf-3675-4699-9179-1d007937cfe1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:24.293697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-35a882bf-3675-4699-9179-1d007937cfe1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:24.303705 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-35a882bf-3675-4699-9179-1d007937cfe1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:24.304305 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-35a882bf-3675-4699-9179-1d007937cfe1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:24.305358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-35a882bf-3675-4699-9179-1d007937cfe1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:24.306012 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-35a882bf-3675-4699-9179-1d007937cfe1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:24.428107 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-47bb8749-8869-4b86-9581-7c6151c0292f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:24.429123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-47bb8749-8869-4b86-9581-7c6151c0292f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:24.436141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-47bb8749-8869-4b86-9581-7c6151c0292f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:24.436924 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-47bb8749-8869-4b86-9581-7c6151c0292f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:24.437959 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-47bb8749-8869-4b86-9581-7c6151c0292f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:24.438638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-47bb8749-8869-4b86-9581-7c6151c0292f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:24.464057 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-35a882bf-3675-4699-9179-1d007937cfe1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:24.472369 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-35a882bf-3675-4699-9179-1d007937cfe1 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.183914 Jul 12 13:21:24.473346 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 439/868] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:24 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:24.607957 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-47bb8749-8869-4b86-9581-7c6151c0292f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:24.616737 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-47bb8749-8869-4b86-9581-7c6151c0292f tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.195156 Jul 12 13:21:24.617318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 430/869] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:24 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:25.156898 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:25.157500 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:25.163689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:25.164133 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:25.164915 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:25.165336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:25.313333 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:25.321742 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:25.323262 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:25.324469 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7536f3e2-37f0-4c04-8a15-9620666d58e4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.171746 Jul 12 13:21:25.325122 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 440/870] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:25 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:25.499948 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-78d84301-810f-454c-bbe9-6d2706d13ade tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:25.500701 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-78d84301-810f-454c-bbe9-6d2706d13ade tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:25.507585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78d84301-810f-454c-bbe9-6d2706d13ade tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:25.508047 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78d84301-810f-454c-bbe9-6d2706d13ade tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:25.508827 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78d84301-810f-454c-bbe9-6d2706d13ade tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:25.509260 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-78d84301-810f-454c-bbe9-6d2706d13ade tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:25.512343 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:25.635214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-199a31d2-0367-4685-93db-8d9849349864 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:25.638178 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-199a31d2-0367-4685-93db-8d9849349864 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:25.652088 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-199a31d2-0367-4685-93db-8d9849349864 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:25.659241 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-199a31d2-0367-4685-93db-8d9849349864 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:25.660347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-199a31d2-0367-4685-93db-8d9849349864 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:25.660867 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-199a31d2-0367-4685-93db-8d9849349864 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:25.738984 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-78d84301-810f-454c-bbe9-6d2706d13ade tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:25.747115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-78d84301-810f-454c-bbe9-6d2706d13ade tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.252572 Jul 12 13:21:25.747695 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 431/871] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:25 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:25.866613 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-199a31d2-0367-4685-93db-8d9849349864 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:25.878293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-199a31d2-0367-4685-93db-8d9849349864 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.247952 Jul 12 13:21:25.889206 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 441/872] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:25 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:26.343323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:26.344254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:26.356872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:26.357358 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:26.358140 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:26.358570 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:26.506166 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:26.515349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:26.516949 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:26.518121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-630caff3-a480-47d4-86ba-d1b883b3156f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.179480 Jul 12 13:21:26.518677 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 432/873] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:26 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:26.767880 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-dd7e5872-0731-4ba3-90c7-048e339cd564 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:26.768740 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-dd7e5872-0731-4ba3-90c7-048e339cd564 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:26.779172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dd7e5872-0731-4ba3-90c7-048e339cd564 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:26.779622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dd7e5872-0731-4ba3-90c7-048e339cd564 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:26.780391 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dd7e5872-0731-4ba3-90c7-048e339cd564 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:26.780821 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dd7e5872-0731-4ba3-90c7-048e339cd564 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:26.902782 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a7fa9793-1800-4ee6-bd69-d83845c7925a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:26.903493 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a7fa9793-1800-4ee6-bd69-d83845c7925a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:26.909945 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a7fa9793-1800-4ee6-bd69-d83845c7925a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:26.910481 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a7fa9793-1800-4ee6-bd69-d83845c7925a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:26.911403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a7fa9793-1800-4ee6-bd69-d83845c7925a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:26.911882 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a7fa9793-1800-4ee6-bd69-d83845c7925a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:26.926561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-dd7e5872-0731-4ba3-90c7-048e339cd564 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:26.938901 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-dd7e5872-0731-4ba3-90c7-048e339cd564 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.176277 Jul 12 13:21:26.943359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 442/874] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:26 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:27.096084 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a7fa9793-1800-4ee6-bd69-d83845c7925a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:27.106532 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a7fa9793-1800-4ee6-bd69-d83845c7925a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.208061 Jul 12 13:21:27.109903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 433/875] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:26 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:27.537071 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:27.537668 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:27.544695 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:27.545136 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:27.545878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:27.546304 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:27.696280 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:27.705964 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:27.707499 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:27.708778 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-16af2ee1-a21e-42db-ad74-70cbb1cead5f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.175735 Jul 12 13:21:27.709336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 443/876] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:27 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:27.954011 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c901c63e-effc-498c-ac0f-5819d663ee23 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:27.954628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c901c63e-effc-498c-ac0f-5819d663ee23 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:27.962911 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c901c63e-effc-498c-ac0f-5819d663ee23 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:27.963524 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c901c63e-effc-498c-ac0f-5819d663ee23 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:27.966270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c901c63e-effc-498c-ac0f-5819d663ee23 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:27.966270 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c901c63e-effc-498c-ac0f-5819d663ee23 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:28.100469 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-c901c63e-effc-498c-ac0f-5819d663ee23 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:28.109352 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c901c63e-effc-498c-ac0f-5819d663ee23 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.159198 Jul 12 13:21:28.110671 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 434/877] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:27 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:28.124622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e379dae1-ce52-47aa-9ddb-44a3bed6d586 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:28.125233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e379dae1-ce52-47aa-9ddb-44a3bed6d586 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:28.131649 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e379dae1-ce52-47aa-9ddb-44a3bed6d586 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:28.132096 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e379dae1-ce52-47aa-9ddb-44a3bed6d586 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:28.132864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e379dae1-ce52-47aa-9ddb-44a3bed6d586 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:28.133297 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e379dae1-ce52-47aa-9ddb-44a3bed6d586 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:28.148534 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:28.291984 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e379dae1-ce52-47aa-9ddb-44a3bed6d586 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:28.305570 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e379dae1-ce52-47aa-9ddb-44a3bed6d586 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.185052 Jul 12 13:21:28.306191 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 444/878] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:28 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:28.731154 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:28.731754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:28.738136 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:28.738578 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:28.739363 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:28.739789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:28.880817 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:28.889365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:28.890855 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:28.892050 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4316639e-4839-4db9-9a02-c9936703317c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.167002 Jul 12 13:21:28.892626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 435/879] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:28 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:29.131668 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-61b1cc70-c9ca-4259-aa57-be6be0f2e19f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:29.132249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-61b1cc70-c9ca-4259-aa57-be6be0f2e19f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:29.139516 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61b1cc70-c9ca-4259-aa57-be6be0f2e19f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:29.139954 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61b1cc70-c9ca-4259-aa57-be6be0f2e19f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:29.141160 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61b1cc70-c9ca-4259-aa57-be6be0f2e19f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:29.141160 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-61b1cc70-c9ca-4259-aa57-be6be0f2e19f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:29.284603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-61b1cc70-c9ca-4259-aa57-be6be0f2e19f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:29.292842 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-61b1cc70-c9ca-4259-aa57-be6be0f2e19f tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.164735 Jul 12 13:21:29.293408 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 445/880] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:29 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:29.323978 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-156dc9e8-d89b-4f23-aedd-8cedafd2c39d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:29.324580 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-156dc9e8-d89b-4f23-aedd-8cedafd2c39d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:29.331550 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-156dc9e8-d89b-4f23-aedd-8cedafd2c39d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:29.331985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-156dc9e8-d89b-4f23-aedd-8cedafd2c39d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:29.332724 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-156dc9e8-d89b-4f23-aedd-8cedafd2c39d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:29.333169 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-156dc9e8-d89b-4f23-aedd-8cedafd2c39d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:29.489139 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-156dc9e8-d89b-4f23-aedd-8cedafd2c39d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:29.499098 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-156dc9e8-d89b-4f23-aedd-8cedafd2c39d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.179029 Jul 12 13:21:29.500393 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 436/881] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:29 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:29.914418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:29.915490 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:29.923862 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:29.924299 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:29.925053 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:29.925480 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:30.071684 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:30.080525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:30.081609 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:30.082858 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0eaeda43-ac2e-464e-9c0d-a3dec4458a58 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.174832 Jul 12 13:21:30.083287 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 446/882] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:29 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:30.312277 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0de2c54b-f5eb-47f7-b72b-e62b8df007d2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:30.312851 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0de2c54b-f5eb-47f7-b72b-e62b8df007d2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:30.314719 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=78 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:30.320458 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0de2c54b-f5eb-47f7-b72b-e62b8df007d2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:30.320899 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0de2c54b-f5eb-47f7-b72b-e62b8df007d2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:30.321657 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0de2c54b-f5eb-47f7-b72b-e62b8df007d2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:30.322084 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0de2c54b-f5eb-47f7-b72b-e62b8df007d2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:30.464040 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0de2c54b-f5eb-47f7-b72b-e62b8df007d2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:30.473322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0de2c54b-f5eb-47f7-b72b-e62b8df007d2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1266 microversion: 2.1 time: 0.166490 Jul 12 13:21:30.473898 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 437/883] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:30 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:30.517258 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1fcedccc-1471-4fc5-9ae4-ea41fc934fd4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:30.517965 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-1fcedccc-1471-4fc5-9ae4-ea41fc934fd4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:30.524763 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1fcedccc-1471-4fc5-9ae4-ea41fc934fd4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:30.525205 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1fcedccc-1471-4fc5-9ae4-ea41fc934fd4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:30.525963 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1fcedccc-1471-4fc5-9ae4-ea41fc934fd4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:30.526387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1fcedccc-1471-4fc5-9ae4-ea41fc934fd4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:30.682395 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-1fcedccc-1471-4fc5-9ae4-ea41fc934fd4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:30.699623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-1fcedccc-1471-4fc5-9ae4-ea41fc934fd4 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.186059 Jul 12 13:21:30.700837 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 447/884] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:30 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:31.105633 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:31.106766 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:31.116831 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:31.117417 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:31.118565 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:31.119161 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:31.257160 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:31.265221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:31.266727 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:31.267915 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-71b4be31-6f9b-4ae8-85c6-7b8283d1cd93 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.169653 Jul 12 13:21:31.268477 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 438/885] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:31 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:31.491349 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-308463f3-25a6-476a-b46f-56f12bbcbcd9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:31.492174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-308463f3-25a6-476a-b46f-56f12bbcbcd9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:31.498568 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-308463f3-25a6-476a-b46f-56f12bbcbcd9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:31.499023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-308463f3-25a6-476a-b46f-56f12bbcbcd9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:31.499829 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-308463f3-25a6-476a-b46f-56f12bbcbcd9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:31.500380 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-308463f3-25a6-476a-b46f-56f12bbcbcd9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:31.643482 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-308463f3-25a6-476a-b46f-56f12bbcbcd9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:31.648250 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-da6727a2-00be-40db-8853-7d740eec0b31 req-088e5ef8-e0a5-4247-9e91-97102ea76a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc", "name": "network-vif-plugged", "status": "completed", "tag": "b51df1af-aa43-43ff-b70a-c0a6ec76b42b"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:31.651504 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-308463f3-25a6-476a-b46f-56f12bbcbcd9 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1453 microversion: 2.1 time: 0.164666 Jul 12 13:21:31.652325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 448/886] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:31 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:31.657862 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-da6727a2-00be-40db-8853-7d740eec0b31 req-088e5ef8-e0a5-4247-9e91-97102ea76a17 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:31.658378 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-da6727a2-00be-40db-8853-7d740eec0b31 req-088e5ef8-e0a5-4247-9e91-97102ea76a17 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:31.670814 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ee824dcc-388d-45fc-a2a1-ccb6aaebcda5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:31.671456 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ee824dcc-388d-45fc-a2a1-ccb6aaebcda5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:31.672621 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-da6727a2-00be-40db-8853-7d740eec0b31 req-088e5ef8-e0a5-4247-9e91-97102ea76a17 service nova] Creating event network-vif-plugged:b51df1af-aa43-43ff-b70a-c0a6ec76b42b for instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc on hv-cinder-79760 Jul 12 13:21:31.677770 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-da6727a2-00be-40db-8853-7d740eec0b31 req-088e5ef8-e0a5-4247-9e91-97102ea76a17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033183 Jul 12 13:21:31.678684 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 439/887] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:21:31.679610 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ee824dcc-388d-45fc-a2a1-ccb6aaebcda5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:31.680062 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ee824dcc-388d-45fc-a2a1-ccb6aaebcda5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:31.680842 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ee824dcc-388d-45fc-a2a1-ccb6aaebcda5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:31.681275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ee824dcc-388d-45fc-a2a1-ccb6aaebcda5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:31.723092 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e6f6240f-c84d-44ea-b90a-106dbd388173 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:31.723802 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e6f6240f-c84d-44ea-b90a-106dbd388173 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:31.731192 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e6f6240f-c84d-44ea-b90a-106dbd388173 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:31.732033 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e6f6240f-c84d-44ea-b90a-106dbd388173 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:31.732976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e6f6240f-c84d-44ea-b90a-106dbd388173 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:31.733410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e6f6240f-c84d-44ea-b90a-106dbd388173 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:31.829809 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ee824dcc-388d-45fc-a2a1-ccb6aaebcda5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:31.837594 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ee824dcc-388d-45fc-a2a1-ccb6aaebcda5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1453 microversion: 2.1 time: 0.171285 Jul 12 13:21:31.838233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 449/888] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:31 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:31.932997 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e6f6240f-c84d-44ea-b90a-106dbd388173 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:31.941349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e6f6240f-c84d-44ea-b90a-106dbd388173 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.223428 Jul 12 13:21:31.942170 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 440/889] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:31 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:32.285921 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:32.286649 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:32.293411 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:32.293935 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:32.294764 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:32.295287 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:32.525159 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:32.534327 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:32.535945 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:32.537094 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-07769f16-0bee-4030-bf3e-781f10978fd8 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.255340 Jul 12 13:21:32.537636 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 450/890] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:32 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:32.960005 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4966ebba-2d22-4fbf-a410-e237faa5837d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:32.960703 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4966ebba-2d22-4fbf-a410-e237faa5837d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:32.968261 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4966ebba-2d22-4fbf-a410-e237faa5837d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:32.968829 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4966ebba-2d22-4fbf-a410-e237faa5837d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:32.969648 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4966ebba-2d22-4fbf-a410-e237faa5837d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:32.970146 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4966ebba-2d22-4fbf-a410-e237faa5837d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:33.123559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4966ebba-2d22-4fbf-a410-e237faa5837d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:33.132152 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4966ebba-2d22-4fbf-a410-e237faa5837d tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.176509 Jul 12 13:21:33.132744 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 441/891] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:32 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:33.555237 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:33.555842 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:33.563315 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:33.563767 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:33.564540 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:33.565107 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:33.705599 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-1c064c11-2385-4588-a41b-eb61cf681ec4 req-35043db7-19e7-4c42-b4a3-2a82e2449190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb9c528-38ad-4408-bb80-7dd426dbe142", "tag": "d140b555-5d1b-4434-853f-5cfc8f27c57e"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:33.715335 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-1c064c11-2385-4588-a41b-eb61cf681ec4 req-35043db7-19e7-4c42-b4a3-2a82e2449190 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:33.715896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-1c064c11-2385-4588-a41b-eb61cf681ec4 req-35043db7-19e7-4c42-b4a3-2a82e2449190 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:33.729461 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-1c064c11-2385-4588-a41b-eb61cf681ec4 req-35043db7-19e7-4c42-b4a3-2a82e2449190 service nova] Creating event network-changed:d140b555-5d1b-4434-853f-5cfc8f27c57e for instance bcb9c528-38ad-4408-bb80-7dd426dbe142 on hv-cinder-79760 Jul 12 13:21:33.735539 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-1c064c11-2385-4588-a41b-eb61cf681ec4 req-35043db7-19e7-4c42-b4a3-2a82e2449190 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033860 Jul 12 13:21:33.736608 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 442/892] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:21:33.758731 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:33.768319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:33.770376 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:33.771120 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-22fbbb8b-5eb4-4506-836a-2fc7f803bb38 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1731 microversion: 2.20 time: 0.220026 Jul 12 13:21:33.771673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 451/893] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:33 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:34.150910 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ae41b31a-fd4d-4921-bafe-71ea8a2f56c1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:34.152048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ae41b31a-fd4d-4921-bafe-71ea8a2f56c1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:34.159809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae41b31a-fd4d-4921-bafe-71ea8a2f56c1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:34.160736 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae41b31a-fd4d-4921-bafe-71ea8a2f56c1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:34.161562 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae41b31a-fd4d-4921-bafe-71ea8a2f56c1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:34.162163 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ae41b31a-fd4d-4921-bafe-71ea8a2f56c1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:34.319465 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-ae41b31a-fd4d-4921-bafe-71ea8a2f56c1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:34.328111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ae41b31a-fd4d-4921-bafe-71ea8a2f56c1 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1755 microversion: 2.1 time: 0.181897 Jul 12 13:21:34.330999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 443/894] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:34 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:34.789656 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:34.790249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:34.793917 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:34.798327 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:34.798766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:34.799553 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:34.799975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:34.970042 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:34.978169 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:34.979682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:34.980818 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c2b74d6c-be97-4412-8582-b23ffb66a955 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1718 microversion: 2.20 time: 0.195158 Jul 12 13:21:34.981346 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 452/895] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:21:34 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1718 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:21:35.345409 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-240e2f31-6dc0-44d9-987e-9679abe5117c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:35.346008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-240e2f31-6dc0-44d9-987e-9679abe5117c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:35.353075 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-240e2f31-6dc0-44d9-987e-9679abe5117c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:35.353518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-240e2f31-6dc0-44d9-987e-9679abe5117c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:35.354326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-240e2f31-6dc0-44d9-987e-9679abe5117c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:35.354761 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-240e2f31-6dc0-44d9-987e-9679abe5117c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:35.500170 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-240e2f31-6dc0-44d9-987e-9679abe5117c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:35.508681 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-240e2f31-6dc0-44d9-987e-9679abe5117c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1758 microversion: 2.1 time: 0.167151 Jul 12 13:21:35.509539 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 444/896] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:35 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:37.080316 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-aa18bf5a-d6e2-4066-b9c5-fb04c1ce1b9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:37.080944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-aa18bf5a-d6e2-4066-b9c5-fb04c1ce1b9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:37.089095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa18bf5a-d6e2-4066-b9c5-fb04c1ce1b9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:37.089630 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa18bf5a-d6e2-4066-b9c5-fb04c1ce1b9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:37.090600 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa18bf5a-d6e2-4066-b9c5-fb04c1ce1b9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:37.091143 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa18bf5a-d6e2-4066-b9c5-fb04c1ce1b9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:37.117927 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-aa18bf5a-d6e2-4066-b9c5-fb04c1ce1b9b tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/ips" status: 200 len: 149 microversion: 2.1 time: 0.042209 Jul 12 13:21:37.118497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 453/897] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:21:37 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:21:38.468880 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c57c04c1-c925-42cc-8412-f408e8d953ad tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f5217a4-da41-4232-ba0e-32b13a85dc69"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:38.470106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c57c04c1-c925-42cc-8412-f408e8d953ad tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:38.476949 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c57c04c1-c925-42cc-8412-f408e8d953ad tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:38.477525 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c57c04c1-c925-42cc-8412-f408e8d953ad tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:38.478301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c57c04c1-c925-42cc-8412-f408e8d953ad tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:38.478763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c57c04c1-c925-42cc-8412-f408e8d953ad tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:38.753333 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c57c04c1-c925-42cc-8412-f408e8d953ad tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "POST /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290918 Jul 12 13:21:38.754187 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 445/898] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:21:38 2022] POST /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:21:46.380176 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6852461f-87b4-480f-9cd1-572a75177a5d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:46.380702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6852461f-87b4-480f-9cd1-572a75177a5d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:46.387637 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6852461f-87b4-480f-9cd1-572a75177a5d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:46.388148 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6852461f-87b4-480f-9cd1-572a75177a5d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:46.389051 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6852461f-87b4-480f-9cd1-572a75177a5d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:46.389525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6852461f-87b4-480f-9cd1-572a75177a5d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:46.470787 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-6852461f-87b4-480f-9cd1-572a75177a5d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lazy-loading 'services' on Instance uuid 5827330e-7872-4e44-8fce-856ad3d2288a {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:21:46.558488 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6852461f-87b4-480f-9cd1-572a75177a5d tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-volume_attachments/3f5217a4-da41-4232-ba0e-32b13a85dc69" status: 202 len: 0 microversion: 2.1 time: 0.182084 Jul 12 13:21:46.559265 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 454/899] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:21:46 2022] DELETE /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-volume_attachments/3f5217a4-da41-4232-ba0e-32b13a85dc69 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:21:46.568477 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-548c9766-621a-445c-871c-726a3c30b71a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:46.569481 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-548c9766-621a-445c-871c-726a3c30b71a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:46.576974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-548c9766-621a-445c-871c-726a3c30b71a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:46.577418 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-548c9766-621a-445c-871c-726a3c30b71a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:46.578269 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-548c9766-621a-445c-871c-726a3c30b71a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:46.578693 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-548c9766-621a-445c-871c-726a3c30b71a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:46.609158 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-548c9766-621a-445c-871c-726a3c30b71a tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Jul 12 13:21:46.609737 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 446/900] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:21:46 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:21:47.622603 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-65e5642a-1d16-4fba-b017-458184a6843e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:47.623689 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-65e5642a-1d16-4fba-b017-458184a6843e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:47.630441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-65e5642a-1d16-4fba-b017-458184a6843e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:47.630932 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-65e5642a-1d16-4fba-b017-458184a6843e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:47.631724 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-65e5642a-1d16-4fba-b017-458184a6843e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:47.632175 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-65e5642a-1d16-4fba-b017-458184a6843e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:47.676046 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-65e5642a-1d16-4fba-b017-458184a6843e tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058207 Jul 12 13:21:47.676619 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 455/901] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:21:47 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 13:21:47.739863 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3e6921df-8494-411e-a7a4-3a7c573f6ce4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:47.741050 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3e6921df-8494-411e-a7a4-3a7c573f6ce4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:47.747393 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e6921df-8494-411e-a7a4-3a7c573f6ce4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:47.747826 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e6921df-8494-411e-a7a4-3a7c573f6ce4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:47.748555 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e6921df-8494-411e-a7a4-3a7c573f6ce4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:47.748975 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3e6921df-8494-411e-a7a4-3a7c573f6ce4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:47.775629 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3e6921df-8494-411e-a7a4-3a7c573f6ce4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:21:47.778460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:21:47.855772 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3e6921df-8494-411e-a7a4-3a7c573f6ce4 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 204 len: 0 microversion: 2.1 time: 0.119687 Jul 12 13:21:47.856507 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 447/902] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:21:47 2022] DELETE /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:21:47.865194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6793d380-4e4b-46ad-8713-d9809c1313fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:47.865791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6793d380-4e4b-46ad-8713-d9809c1313fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:47.872384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6793d380-4e4b-46ad-8713-d9809c1313fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:47.872830 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6793d380-4e4b-46ad-8713-d9809c1313fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:47.873584 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6793d380-4e4b-46ad-8713-d9809c1313fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:47.874007 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6793d380-4e4b-46ad-8713-d9809c1313fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:48.008433 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6793d380-4e4b-46ad-8713-d9809c1313fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:48.017505 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6793d380-4e4b-46ad-8713-d9809c1313fb tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1682 microversion: 2.1 time: 0.155290 Jul 12 13:21:48.017505 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 456/903] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:47 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:49.034441 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d67896cc-74df-4af1-b6b1-26a6826fd115 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:49.035178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d67896cc-74df-4af1-b6b1-26a6826fd115 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:49.042502 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d67896cc-74df-4af1-b6b1-26a6826fd115 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:49.042887 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d67896cc-74df-4af1-b6b1-26a6826fd115 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:49.043675 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d67896cc-74df-4af1-b6b1-26a6826fd115 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:49.044097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d67896cc-74df-4af1-b6b1-26a6826fd115 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:49.220161 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d67896cc-74df-4af1-b6b1-26a6826fd115 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:49.228902 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d67896cc-74df-4af1-b6b1-26a6826fd115 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1682 microversion: 2.1 time: 0.198728 Jul 12 13:21:49.229867 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 448/904] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:49 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:21:50.245854 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-07cf267d-5ab2-4a7c-a2d1-f0074a0aee14 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:50.246442 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-07cf267d-5ab2-4a7c-a2d1-f0074a0aee14 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:50.253827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07cf267d-5ab2-4a7c-a2d1-f0074a0aee14 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:50.254484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07cf267d-5ab2-4a7c-a2d1-f0074a0aee14 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:50.255630 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07cf267d-5ab2-4a7c-a2d1-f0074a0aee14 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:50.256076 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-07cf267d-5ab2-4a7c-a2d1-f0074a0aee14 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:50.708147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-07cf267d-5ab2-4a7c-a2d1-f0074a0aee14 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:50.716193 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-07cf267d-5ab2-4a7c-a2d1-f0074a0aee14 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1682 microversion: 2.1 time: 0.473941 Jul 12 13:21:50.716902 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 457/905] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:50 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1682 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:51.088173 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-9a78d912-9a24-4809-9ea5-18258521e242 req-4dc2d223-6359-4fa2-8e62-cbc6f3ebd8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5827330e-7872-4e44-8fce-856ad3d2288a", "name": "network-vif-deleted", "tag": "782480f4-c49a-4f49-8e72-6122c9083b2b"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:21:51.097814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-9a78d912-9a24-4809-9ea5-18258521e242 req-4dc2d223-6359-4fa2-8e62-cbc6f3ebd8c9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:51.098371 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-9a78d912-9a24-4809-9ea5-18258521e242 req-4dc2d223-6359-4fa2-8e62-cbc6f3ebd8c9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:51.110670 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-9a78d912-9a24-4809-9ea5-18258521e242 req-4dc2d223-6359-4fa2-8e62-cbc6f3ebd8c9 service nova] Creating event network-vif-deleted:782480f4-c49a-4f49-8e72-6122c9083b2b for instance 5827330e-7872-4e44-8fce-856ad3d2288a on hv-cinder-79760 Jul 12 13:21:51.115730 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-9a78d912-9a24-4809-9ea5-18258521e242 req-4dc2d223-6359-4fa2-8e62-cbc6f3ebd8c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031379 Jul 12 13:21:51.117029 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 449/906] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:21:51.735747 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:51.736975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:51.743654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:51.744103 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:51.744877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:51.745312 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:51.782017 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:51.782623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:51.783307 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lazy-loading 'fault' on Instance uuid 5827330e-7872-4e44-8fce-856ad3d2288a {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:21:51.833684 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8380cfce8114b609c8f0cbf9d445049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b19369c5bc0547ccbfcfdfc102d3593c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:21:51.840958 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-98587f7b-9d2d-4b43-88c1-61b95957e4be tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 200 len: 1332 microversion: 2.1 time: 0.108917 Jul 12 13:21:51.841351 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 458/907] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:51 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:21:52.863648 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:52.864841 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:52.875509 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:52.876300 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:52.877173 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:52.877600 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:52.891134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a HTTP/1.1 Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:21:52.892779 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:52.894404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '5827330e-7872-4e44-8fce-856ad3d2288a'} Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:52.895319 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:52.896617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:52.897758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:52.897758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7e8fe56a-507d-49ff-9049-eeff72002ea2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 404 len: 111 microversion: 2.1 time: 0.038429 Jul 12 13:21:52.897758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 450/908] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:52 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:21:52.903112 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6625ebff-aafa-4d3e-b02f-66f101f26004 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '.version_select at 0x7fd48d042e50>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:52.924123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6625ebff-aafa-4d3e-b02f-66f101f26004 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113206513" status: 202 len: 0 microversion: 2.1 time: 0.024870 Jul 12 13:21:52.924705 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 459/909] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 12 13:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113206513 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 13:21:54.702642 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:54.703647 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:54.711326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:54.711765 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:54.712515 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:54.712936 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:54.727419 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a HTTP/1.1 Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:21:54.728969 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.730564 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '5827330e-7872-4e44-8fce-856ad3d2288a'} Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:54.731523 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.732940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.734352 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:54.734352 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-59291e27-4500-43a2-8047-e4aad208c964 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 404 len: 111 microversion: 2.1 time: 0.034223 Jul 12 13:21:54.734352 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 451/910] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:21:54 2022] DELETE /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:21:54.739604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:54.740305 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 5827330e-7872-4e44-8fce-856ad3d2288a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:54.747370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:54.747898 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:54.748846 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:54.749310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:54.763264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a HTTP/1.1 Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:21:54.764916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.766574 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '5827330e-7872-4e44-8fce-856ad3d2288a'} Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:54.770478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. Jul 12 13:21:54.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:54.773020 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 5827330e-7872-4e44-8fce-856ad3d2288a could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:54.773020 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3a443da6-b7ec-49b0-aca0-2a0e5455ecc5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a" status: 404 len: 111 microversion: 2.1 time: 0.031250 Jul 12 13:21:54.773020 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 460/911] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:54 2022] GET /compute/v2.1/servers/5827330e-7872-4e44-8fce-856ad3d2288a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:21:55.914358 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:55.914974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:55.924631 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:55.925248 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:55.926365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:55.926906 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:55.944459 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 HTTP/1.1 Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:21:55.945999 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.947410 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '4a9dca1a-25b5-4890-9c3a-33514d11fdd3'} Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:55.948141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.949581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.951112 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:55.951112 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-52708223-0d5d-41ee-8602-347dff8dd7e2 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 404 len: 111 microversion: 2.1 time: 0.038506 Jul 12 13:21:55.951112 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 452/912] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:21:55 2022] DELETE /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:21:55.956182 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:55.956877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 4a9dca1a-25b5-4890-9c3a-33514d11fdd3] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:55.963688 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:55.964129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:55.964880 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:55.965307 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:55.978806 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 HTTP/1.1 Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:21:55.980292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.981925 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '4a9dca1a-25b5-4890-9c3a-33514d11fdd3'} Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:55.982766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. Jul 12 13:21:55.984194 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:55.985526 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 4a9dca1a-25b5-4890-9c3a-33514d11fdd3 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:55.985526 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-dfa97140-dc1e-4f8f-b84e-98c5f60841d3 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3" status: 404 len: 111 microversion: 2.1 time: 0.029409 Jul 12 13:21:55.985526 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 461/913] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:55 2022] GET /compute/v2.1/servers/4a9dca1a-25b5-4890-9c3a-33514d11fdd3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:21:55.990423 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:55.990940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:55.997409 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:55.997858 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:55.998618 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:55.999078 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:56.012842 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a HTTP/1.1 Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:21:56.014382 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.015889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '8d99dc0b-1835-4e7b-816b-2315dbe1a12a'} Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:56.016996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.018656 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.020207 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:56.020207 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c7ca9671-5e9e-4fad-8d11-c95050d70a4f tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 404 len: 111 microversion: 2.1 time: 0.029469 Jul 12 13:21:56.020207 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 453/914] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:21:55 2022] DELETE /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:21:56.024404 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:56.025012 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 8d99dc0b-1835-4e7b-816b-2315dbe1a12a] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:56.031495 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:56.031947 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:56.032805 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:56.033268 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:56.047238 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a HTTP/1.1 Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:21:56.049000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.050409 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '8d99dc0b-1835-4e7b-816b-2315dbe1a12a'} Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:56.051228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. Jul 12 13:21:56.052719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:56.053995 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 8d99dc0b-1835-4e7b-816b-2315dbe1a12a could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:56.053995 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-08ca520b-d3bd-4378-a5b7-5d89f77f65a5 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a" status: 404 len: 111 microversion: 2.1 time: 0.029873 Jul 12 13:21:56.053995 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 462/915] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:56 2022] GET /compute/v2.1/servers/8d99dc0b-1835-4e7b-816b-2315dbe1a12a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:21:57.196743 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:57.197299 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:57.204857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:57.205301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:57.206050 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:57.206470 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:57.222131 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 HTTP/1.1 Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:21:57.223690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.225397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '55eb648a-8acd-4221-9b30-5fcabf1d4266'} Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:57.226322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.227860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.229679 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:57.229679 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-71641149-b183-4d47-a354-5711843cc7e8 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 404 len: 111 microversion: 2.1 time: 0.032335 Jul 12 13:21:57.229679 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 454/916] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:21:57 2022] DELETE /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:21:57.233701 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:21:57.234311 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] [instance: 55eb648a-8acd-4221-9b30-5fcabf1d4266] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:21:57.241772 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:57.242219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:57.242999 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:21:57.243479 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:21:57.257189 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] HTTP exception thrown: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Request method failure captured: Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 HTTP/1.1 Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPkk-rwSN8hLhgYKXXqCvobgJxiqrtY74xbeSq3Z-LYySxMb7NrM9iSbJeFWVYPL2yAaynHggkKEHbzY8TwEFUbTqM-HEWCghR4IeVKPV-SQFDVGiihZV4W2iROXQnexXOAyPYrcWWtUhS0EFGtFicBPRtv-z1lMfffGcdI-Dywo_0 Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:21:57.258707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b19369c5bc0547ccbfcfdfc102d3593c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: b19369c5bc0547ccbfcfdfc102d3593c Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1555526590 Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: c8380cfce8114b609c8f0cbf9d445049 Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeNegativeTest-1555526590-project Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.260566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '55eb648a-8acd-4221-9b30-5fcabf1d4266'} Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:21:57.266878 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. Jul 12 13:21:57.268877 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:21:57.270193 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] Returning 404 to user: Instance 55eb648a-8acd-4221-9b30-5fcabf1d4266 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:21:57.270193 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ea776c80-d50e-4da7-a48b-b2bcb0600b66 tempest-AttachVolumeNegativeTest-1555526590 tempest-AttachVolumeNegativeTest-1555526590-project] 10.222.0.33 "GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266" status: 404 len: 111 microversion: 2.1 time: 0.030413 Jul 12 13:21:57.270193 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 463/917] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:21:57 2022] GET /compute/v2.1/servers/55eb648a-8acd-4221-9b30-5fcabf1d4266 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:22:16.759532 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6ec0a353-77ba-4728-b735-043625384228 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:16.760456 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6ec0a353-77ba-4728-b735-043625384228 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:16.763060 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:16.763700 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:16.770184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ec0a353-77ba-4728-b735-043625384228 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:16.770626 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ec0a353-77ba-4728-b735-043625384228 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:16.771412 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ec0a353-77ba-4728-b735-043625384228 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:16.771838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ec0a353-77ba-4728-b735-043625384228 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:16.803798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6ec0a353-77ba-4728-b735-043625384228 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048225 Jul 12 13:22:16.804339 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 455/918] 10.222.0.33 () {60 vars in 1342 bytes} [Tue Jul 12 13:22:16 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:16.870989 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-03d4d0d2-cb57-46d2-9804-a3cb46e0751b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:16.871529 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-03d4d0d2-cb57-46d2-9804-a3cb46e0751b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:16.873616 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:16.874259 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:16.880614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-03d4d0d2-cb57-46d2-9804-a3cb46e0751b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:16.881109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-03d4d0d2-cb57-46d2-9804-a3cb46e0751b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:16.882021 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-03d4d0d2-cb57-46d2-9804-a3cb46e0751b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:16.882440 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-03d4d0d2-cb57-46d2-9804-a3cb46e0751b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:16.911122 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-03d4d0d2-cb57-46d2-9804-a3cb46e0751b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:22:16.996929 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-03d4d0d2-cb57-46d2-9804-a3cb46e0751b tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 204 len: 0 microversion: 2.20 time: 0.129769 Jul 12 13:22:16.997490 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 464/919] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 12 13:22:16 2022] DELETE /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 13:22:17.005748 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:17.006358 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:17.012962 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:17.013267 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:17.014109 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:17.014541 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:17.160068 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:17.168961 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:17.170527 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:17.171803 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2d30c900-b92c-4344-a304-224998c67c89 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.170054 Jul 12 13:22:17.172348 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 456/920] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:22:17 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:22:18.199630 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:18.201310 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:18.211151 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:18.211587 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:18.212358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:18.213012 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:18.356388 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:18.364906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:18.366741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:18.367552 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d1d3493d-1ea5-498a-9ae8-041dd810b9cc tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1724 microversion: 2.20 time: 0.177224 Jul 12 13:22:18.368099 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 465/921] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:22:18 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:22:19.194571 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7c71f8dc-5ae8-449a-9e60-ae0bf82df1ea tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-571207591"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:19.195322 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7c71f8dc-5ae8-449a-9e60-ae0bf82df1ea tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:19.203580 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7c71f8dc-5ae8-449a-9e60-ae0bf82df1ea tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:19.204245 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7c71f8dc-5ae8-449a-9e60-ae0bf82df1ea tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:19.205458 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7c71f8dc-5ae8-449a-9e60-ae0bf82df1ea tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:19.206239 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7c71f8dc-5ae8-449a-9e60-ae0bf82df1ea tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:19.347926 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.network.security_group_api [None req-7c71f8dc-5ae8-449a-9e60-ae0bf82df1ea tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Removing security group 22e350cb-0153-47ce-9e09-2729bceb85e3 from port 2b671be9-4c90-497b-a3b6-75b9a1ced246 Jul 12 13:22:19.386727 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:19.388129 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:19.395667 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:19.396967 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:19.398042 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:19.398577 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:19.498284 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:19.506498 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:19.508348 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b4bdaf5c1964d629cd417e41ff8a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69fbc5a39eab44419423278adc1cf201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:19.509660 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-58040a6b-0376-4b0b-bda9-a7b40523c5aa tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 200 len: 1656 microversion: 2.20 time: 0.127852 Jul 12 13:22:19.510754 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 466/922] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:22:19 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 1656 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:22:19.637761 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-b74413c5-bdfc-4d56-a15b-8c2cf480f987 req-a86d5966-6651-464f-8e00-79afaf4aaaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc", "name": "network-vif-deleted", "tag": "b51df1af-aa43-43ff-b70a-c0a6ec76b42b"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:19.648162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-b74413c5-bdfc-4d56-a15b-8c2cf480f987 req-a86d5966-6651-464f-8e00-79afaf4aaaeb service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:19.648846 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-b74413c5-bdfc-4d56-a15b-8c2cf480f987 req-a86d5966-6651-464f-8e00-79afaf4aaaeb service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:19.664338 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-b74413c5-bdfc-4d56-a15b-8c2cf480f987 req-a86d5966-6651-464f-8e00-79afaf4aaaeb service nova] Creating event network-vif-deleted:b51df1af-aa43-43ff-b70a-c0a6ec76b42b for instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc on hv-cinder-79760 Jul 12 13:22:19.670449 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-b74413c5-bdfc-4d56-a15b-8c2cf480f987 req-a86d5966-6651-464f-8e00-79afaf4aaaeb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038039 Jul 12 13:22:19.675558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 467/923] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 12 13:22:19.772634 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7c71f8dc-5ae8-449a-9e60-ae0bf82df1ea tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "POST /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/action" status: 202 len: 0 microversion: 2.1 time: 0.582140 Jul 12 13:22:19.774019 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 457/924] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:22:19 2022] POST /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:22:19.793985 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-7e34bada-20c8-474f-9588-657ceaf81b80 req-ddeab134-4cf0-498e-9c3d-96a22fe1d617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace38168-9c22-45ee-9115-1dcc8f236117", "tag": "2b671be9-4c90-497b-a3b6-75b9a1ced246"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:19.833705 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-7e34bada-20c8-474f-9588-657ceaf81b80 req-ddeab134-4cf0-498e-9c3d-96a22fe1d617 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:19.839441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-7e34bada-20c8-474f-9588-657ceaf81b80 req-ddeab134-4cf0-498e-9c3d-96a22fe1d617 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:19.874253 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-7e34bada-20c8-474f-9588-657ceaf81b80 req-ddeab134-4cf0-498e-9c3d-96a22fe1d617 service nova] Creating event network-changed:2b671be9-4c90-497b-a3b6-75b9a1ced246 for instance ace38168-9c22-45ee-9115-1dcc8f236117 on hv-cinder-79760 Jul 12 13:22:19.897713 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-7e34bada-20c8-474f-9588-657ceaf81b80 req-ddeab134-4cf0-498e-9c3d-96a22fe1d617 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112252 Jul 12 13:22:19.898939 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 468/925] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:22:20.530318 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:20.532387 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:20.543547 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:20.545143 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:20.547345 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:20.548291 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:20.562577 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] HTTP exception thrown: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Request method failure captured: Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc HTTP/1.1 Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPk0z5A-Lj4TbkQ-Fjid6UCVaqgOCy_DJXP51QGNEIJlypBHKTBsXVo7GZWHfuIYcUvpSaT2dXk0fGdhyiV_BbwGR5UL5ttTGotDN2dQIwGY_bRf8Q1sdnbS7Yt1xbaLMz8JTCnY1Qoi9cNMl4r6A0mm6z6gvUEeSInyZTJZd_0Ss8 Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:22:20.564442 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69fbc5a39eab44419423278adc1cf201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 0b4bdaf5c1964d629cd417e41ff8a21c Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:20.565987 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc'} Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:22:20.566752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:20.568752 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:20.572290 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Returning 404 to user: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:22:20.574381 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7612bbfa-4df7-40ae-85bd-2343045a15b4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 404 len: 111 microversion: 2.20 time: 0.048995 Jul 12 13:22:20.575407 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 458/926] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:22:20 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 13:22:20.584410 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-21feb1f6-b6be-44aa-bef7-96d2d12f6af4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '.version_select at 0x7fd48cf693a0>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:20.603903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-21feb1f6-b6be-44aa-bef7-96d2d12f6af4 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-822687475" status: 204 len: 0 microversion: 2.20 time: 0.023618 Jul 12 13:22:20.605179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 469/927] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Jul 12 13:22:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-822687475 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 13:22:21.388332 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-977235f6-e7dd-424b-a215-7cd32426a2ee tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:21.389086 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-977235f6-e7dd-424b-a215-7cd32426a2ee tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:21.396672 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-977235f6-e7dd-424b-a215-7cd32426a2ee tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:21.397356 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-977235f6-e7dd-424b-a215-7cd32426a2ee tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:21.398299 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-977235f6-e7dd-424b-a215-7cd32426a2ee tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:21.398887 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-977235f6-e7dd-424b-a215-7cd32426a2ee tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:21.496789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-977235f6-e7dd-424b-a215-7cd32426a2ee tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lazy-loading 'services' on Instance uuid ace38168-9c22-45ee-9115-1dcc8f236117 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:22:21.587935 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-977235f6-e7dd-424b-a215-7cd32426a2ee tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments/9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509" status: 202 len: 0 microversion: 2.1 time: 0.203693 Jul 12 13:22:21.588510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 459/928] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:22:21 2022] DELETE /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments/9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:22:21.598628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e45012c8-2200-4902-889e-9847b78c636c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:21.599919 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e45012c8-2200-4902-889e-9847b78c636c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:21.608290 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e45012c8-2200-4902-889e-9847b78c636c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:21.608909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e45012c8-2200-4902-889e-9847b78c636c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:21.609932 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e45012c8-2200-4902-889e-9847b78c636c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:21.610583 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e45012c8-2200-4902-889e-9847b78c636c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:21.642399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e45012c8-2200-4902-889e-9847b78c636c tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049093 Jul 12 13:22:21.643077 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 470/929] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:22:21 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:22:21.918301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-ef44f62f-e74c-4f2e-9ba2-f52727e638c7 req-0dfa71f3-2d66-4f1c-8ac5-79be407a3c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace38168-9c22-45ee-9115-1dcc8f236117", "tag": "2b671be9-4c90-497b-a3b6-75b9a1ced246"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:21.928606 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ef44f62f-e74c-4f2e-9ba2-f52727e638c7 req-0dfa71f3-2d66-4f1c-8ac5-79be407a3c9f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:21.929383 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ef44f62f-e74c-4f2e-9ba2-f52727e638c7 req-0dfa71f3-2d66-4f1c-8ac5-79be407a3c9f service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:21.942334 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-ef44f62f-e74c-4f2e-9ba2-f52727e638c7 req-0dfa71f3-2d66-4f1c-8ac5-79be407a3c9f service nova] Creating event network-changed:2b671be9-4c90-497b-a3b6-75b9a1ced246 for instance ace38168-9c22-45ee-9115-1dcc8f236117 on hv-cinder-79760 Jul 12 13:22:21.947361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-ef44f62f-e74c-4f2e-9ba2-f52727e638c7 req-0dfa71f3-2d66-4f1c-8ac5-79be407a3c9f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033301 Jul 12 13:22:21.948051 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 460/930] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:22:22.647547 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:22.648117 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:22.654647 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-177f75e3-e742-4f2c-94b3-11634a21c434 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:22.655119 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:22.655448 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:22.655692 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-177f75e3-e742-4f2c-94b3-11634a21c434 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:22.656214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:22.656648 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:22.663320 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-177f75e3-e742-4f2c-94b3-11634a21c434 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:22.663818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-177f75e3-e742-4f2c-94b3-11634a21c434 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:22.664584 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-177f75e3-e742-4f2c-94b3-11634a21c434 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:22.665184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-177f75e3-e742-4f2c-94b3-11634a21c434 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:22.686714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] HTTP exception thrown: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Request method failure captured: Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: DELETE /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc HTTP/1.1 Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPk0z5A-Lj4TbkQ-Fjid6UCVaqgOCy_DJXP51QGNEIJlypBHKTBsXVo7GZWHfuIYcUvpSaT2dXk0fGdhyiV_BbwGR5UL5ttTGotDN2dQIwGY_bRf8Q1sdnbS7Yt1xbaLMz8JTCnY1Qoi9cNMl4r6A0mm6z6gvUEeSInyZTJZd_0Ss8 Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:22:22.688524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69fbc5a39eab44419423278adc1cf201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 0b4bdaf5c1964d629cd417e41ff8a21c Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.690226 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc'} Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:22:22.694089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.695597 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.697093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Returning 404 to user: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:22:22.697093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-577dfccb-07e0-4a5b-9b69-c9429443d76a tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 404 len: 111 microversion: 2.20 time: 0.046456 Jul 12 13:22:22.697093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 471/931] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 12 13:22:22 2022] DELETE /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 13:22:22.698274 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:22.698879 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:22.702425 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-177f75e3-e742-4f2c-94b3-11634a21c434 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052586 Jul 12 13:22:22.706404 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 461/932] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:22:22 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:22:22.706570 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:22.706570 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:22.706570 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:22.706833 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:22.722986 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] HTTP exception thrown: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Request method failure captured: Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc HTTP/1.1 Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXPk0z5A-Lj4TbkQ-Fjid6UCVaqgOCy_DJXP51QGNEIJlypBHKTBsXVo7GZWHfuIYcUvpSaT2dXk0fGdhyiV_BbwGR5UL5ttTGotDN2dQIwGY_bRf8Q1sdnbS7Yt1xbaLMz8JTCnY1Qoi9cNMl4r6A0mm6z6gvUEeSInyZTJZd_0Ss8 Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:22:22.724458 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69fbc5a39eab44419423278adc1cf201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 0b4bdaf5c1964d629cd417e41ff8a21c Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.726165 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc'} Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:22:22.730065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. Jul 12 13:22:22.731604 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:22.733032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Returning 404 to user: Instance 6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:22:22.733032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-aee7e9d0-d020-4d71-abf0-f125e029fc1c tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc" status: 404 len: 111 microversion: 2.20 time: 0.031461 Jul 12 13:22:22.733032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 472/933] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:22:22 2022] GET /compute/v2.1/servers/6bd01a0e-64c4-4a9f-bc7e-dd0c3a0c50fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:22:23.718125 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a235facb-eba6-4ed3-92ab-94068735aff7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:23.720403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a235facb-eba6-4ed3-92ab-94068735aff7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:23.735158 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a235facb-eba6-4ed3-92ab-94068735aff7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:23.736156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a235facb-eba6-4ed3-92ab-94068735aff7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:23.737026 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a235facb-eba6-4ed3-92ab-94068735aff7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:23.737480 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a235facb-eba6-4ed3-92ab-94068735aff7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:23.774786 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a235facb-eba6-4ed3-92ab-94068735aff7 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063480 Jul 12 13:22:23.775396 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 462/934] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:22:23 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:22:23.787791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:23.788369 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:23.795733 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:23.796200 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:23.797219 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:23.797684 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:23.865778 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:23.866360 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:23.872931 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:23.873405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:23.874292 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:23.874703 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:23.882714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] HTTP exception thrown: Instance ace38168-9c22-45ee-9115-1dcc8f236117 is not attached to volume 9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509 Jul 12 13:22:23.888912 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] HTTP exception thrown: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Request method failure captured: Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: DELETE /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc HTTP/1.1 Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPk0z5A-Lj4TbkQ-Fjid6UCVaqgOCy_DJXP51QGNEIJlypBHKTBsXVo7GZWHfuIYcUvpSaT2dXk0fGdhyiV_BbwGR5UL5ttTGotDN2dQIwGY_bRf8Q1sdnbS7Yt1xbaLMz8JTCnY1Qoi9cNMl4r6A0mm6z6gvUEeSInyZTJZd_0Ss8 Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:22:23.890653 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69fbc5a39eab44419423278adc1cf201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 0b4bdaf5c1964d629cd417e41ff8a21c Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.892966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '07a8f841-941e-4a72-a5c0-66cf4c1f7ebc'} Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:22:23.893742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.895669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.897989 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Returning 404 to user: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:22:23.897989 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bcb352bb-5e9e-4b2e-8873-1553747cce68 tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "DELETE /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 404 len: 111 microversion: 2.20 time: 0.031335 Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Request method failure captured: Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: DELETE /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments/9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509 HTTP/1.1 Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXTs61MgXY8xQv5n28v6ZClIuXewwxAHWDho2M3bS0mUdu2HrsMWEp1I4LyZvdfvphvVRUvEG9BenNevh1eNCZLt6gRpY2eVkEgsNylxnUVmW88OP6A0k5Q54OXJBjXiG_N0S1ztnMe4grhL3jfTef6uKOw9VpHVjuuN9397wHd8aB4 Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 7ba94948f8ed41e3a3a9052aa2320f24 Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-TestMinimumBasicScenario-1675201192 Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:22:23.898172 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ba94948f8ed41e3a3a9052aa2320f24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ba94948f8ed41e3a3a9052aa2320f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ba94948f8ed41e3a3a9052aa2320f24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ba94948f8ed41e3a3a9052aa2320f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-TestMinimumBasicScenario-1675201192 Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 7ba94948f8ed41e3a3a9052aa2320f24 Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1675201192 Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-TestMinimumBasicScenario-1675201192-project Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: e3bb2983cd4a4e27a73d46101fafea23 Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-TestMinimumBasicScenario-1675201192-project Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:22:23.899661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance ace38168-9c22-45ee-9115-1dcc8f236117 is not attached to volume 9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509 Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'server_id': 'ace38168-9c22-45ee-9115-1dcc8f236117', 'id': '9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509'} Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509. Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:22:23.900702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace38168-9c22-45ee-9115-1dcc8f236117 is not attached to volume 9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509 Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace38168-9c22-45ee-9115-1dcc8f236117 is not attached to volume 9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509 Jul 12 13:22:23.902977 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.904381 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 463/935] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Jul 12 13:22:23 2022] DELETE /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 13:22:23.904490 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Returning 404 to user: Instance ace38168-9c22-45ee-9115-1dcc8f236117 is not attached to volume 9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509 {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:22:23.904490 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-bd5fd3db-92ae-4237-9169-bd4025175612 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments/9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509" status: 404 len: 154 microversion: 2.1 time: 0.111797 Jul 12 13:22:23.904490 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 473/936] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:22:23 2022] DELETE /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117/os-volume_attachments/9b5cc04b-7cf5-4b24-81c1-a5e11b5cf509 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:22:23.904735 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:23.904735 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] [instance: 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:23.908649 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:23.909121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:23.909878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:23.910308 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:23.926563 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] HTTP exception thrown: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Request method failure captured: Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc HTTP/1.1 Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXPk0z5A-Lj4TbkQ-Fjid6UCVaqgOCy_DJXP51QGNEIJlypBHKTBsXVo7GZWHfuIYcUvpSaT2dXk0fGdhyiV_BbwGR5UL5ttTGotDN2dQIwGY_bRf8Q1sdnbS7Yt1xbaLMz8JTCnY1Qoi9cNMl4r6A0mm6z6gvUEeSInyZTJZd_0Ss8 Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:22:23.928123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69fbc5a39eab44419423278adc1cf201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69fbc5a39eab44419423278adc1cf201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 69fbc5a39eab44419423278adc1cf201 Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-799976913 Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 0b4bdaf5c1964d629cd417e41ff8a21c Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeShelveTestJSON-799976913-project Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.931758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '07a8f841-941e-4a72-a5c0-66cf4c1f7ebc'} Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:22:23.933221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. Jul 12 13:22:23.936662 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:23.941365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] Returning 404 to user: Instance 07a8f841-941e-4a72-a5c0-66cf4c1f7ebc could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:22:23.941365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b3e1cb80-4b68-4cf9-a8fa-30975d25093f tempest-AttachVolumeShelveTestJSON-799976913 tempest-AttachVolumeShelveTestJSON-799976913-project] 10.222.0.33 "GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc" status: 404 len: 111 microversion: 2.20 time: 0.032293 Jul 12 13:22:23.941365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 464/937] 10.222.0.33 () {60 vars in 1276 bytes} [Tue Jul 12 13:22:23 2022] GET /compute/v2.1/servers/07a8f841-941e-4a72-a5c0-66cf4c1f7ebc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:22:25.611266 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-420dbc57-acff-4453-881a-65588ed62666 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:25.611740 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-420dbc57-acff-4453-881a-65588ed62666 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:25.617674 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-968e758c-5dbc-4f46-b2ca-849b46e068b0 req-03024317-9121-4415-bfb1-20ff2d964cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1b8589-d954-4806-9228-47ea80451712", "tag": "22d70302-4120-482b-8c1c-525d7d7ba7f4"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:25.619994 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-420dbc57-acff-4453-881a-65588ed62666 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:25.620438 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-420dbc57-acff-4453-881a-65588ed62666 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:25.621200 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-420dbc57-acff-4453-881a-65588ed62666 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:25.621623 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-420dbc57-acff-4453-881a-65588ed62666 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:25.628219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-968e758c-5dbc-4f46-b2ca-849b46e068b0 req-03024317-9121-4415-bfb1-20ff2d964cba service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:25.628657 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-968e758c-5dbc-4f46-b2ca-849b46e068b0 req-03024317-9121-4415-bfb1-20ff2d964cba service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:25.654863 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-968e758c-5dbc-4f46-b2ca-849b46e068b0 req-03024317-9121-4415-bfb1-20ff2d964cba service nova] Creating event network-changed:22d70302-4120-482b-8c1c-525d7d7ba7f4 for instance 5c1b8589-d954-4806-9228-47ea80451712 on hv-cinder-79760 Jul 12 13:22:25.656514 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-420dbc57-acff-4453-881a-65588ed62666 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:22:25.662860 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-968e758c-5dbc-4f46-b2ca-849b46e068b0 req-03024317-9121-4415-bfb1-20ff2d964cba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049210 Jul 12 13:22:25.663798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 465/938] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:22:25.741109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-420dbc57-acff-4453-881a-65588ed62666 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 204 len: 0 microversion: 2.1 time: 0.134130 Jul 12 13:22:25.744866 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 474/939] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:22:25 2022] DELETE /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:22:25.750584 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f8e2c17d-5dab-4dfa-a902-c33fed269b5b tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:25.751362 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f8e2c17d-5dab-4dfa-a902-c33fed269b5b tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:25.760139 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8e2c17d-5dab-4dfa-a902-c33fed269b5b tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:25.765567 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8e2c17d-5dab-4dfa-a902-c33fed269b5b tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:25.767068 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8e2c17d-5dab-4dfa-a902-c33fed269b5b tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:25.767582 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f8e2c17d-5dab-4dfa-a902-c33fed269b5b tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:25.933621 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f8e2c17d-5dab-4dfa-a902-c33fed269b5b tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:25.946273 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f8e2c17d-5dab-4dfa-a902-c33fed269b5b tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.199836 Jul 12 13:22:25.947173 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 466/940] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:25 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:26.967388 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-246d7f42-8c3b-4c82-bfc8-df5ee725506a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:26.969614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-246d7f42-8c3b-4c82-bfc8-df5ee725506a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:26.980634 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-246d7f42-8c3b-4c82-bfc8-df5ee725506a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:26.981080 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-246d7f42-8c3b-4c82-bfc8-df5ee725506a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:26.982407 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-246d7f42-8c3b-4c82-bfc8-df5ee725506a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:26.982843 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-246d7f42-8c3b-4c82-bfc8-df5ee725506a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:27.135615 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-246d7f42-8c3b-4c82-bfc8-df5ee725506a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:27.143642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-246d7f42-8c3b-4c82-bfc8-df5ee725506a tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.182539 Jul 12 13:22:27.144299 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 475/941] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:26 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:28.161092 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e7d56a7c-e1f9-4b32-9153-d839ccc92471 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:28.161909 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e7d56a7c-e1f9-4b32-9153-d839ccc92471 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:28.168879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7d56a7c-e1f9-4b32-9153-d839ccc92471 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:28.169240 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7d56a7c-e1f9-4b32-9153-d839ccc92471 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:28.170099 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7d56a7c-e1f9-4b32-9153-d839ccc92471 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:28.170546 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e7d56a7c-e1f9-4b32-9153-d839ccc92471 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:28.324521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e7d56a7c-e1f9-4b32-9153-d839ccc92471 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:28.332156 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e7d56a7c-e1f9-4b32-9153-d839ccc92471 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.175037 Jul 12 13:22:28.332767 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 467/942] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:28 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:29.349961 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-62868e48-5e8f-4b3b-b46a-c81bb9d12d74 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:29.350560 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-62868e48-5e8f-4b3b-b46a-c81bb9d12d74 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:29.356904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62868e48-5e8f-4b3b-b46a-c81bb9d12d74 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:29.357582 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62868e48-5e8f-4b3b-b46a-c81bb9d12d74 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:29.358710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62868e48-5e8f-4b3b-b46a-c81bb9d12d74 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:29.359347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62868e48-5e8f-4b3b-b46a-c81bb9d12d74 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:29.626633 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-62868e48-5e8f-4b3b-b46a-c81bb9d12d74 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:29.635182 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-62868e48-5e8f-4b3b-b46a-c81bb9d12d74 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.289227 Jul 12 13:22:29.636079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 476/943] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:29 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:30.381782 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7d79ff02-6b96-4f9d-aaa3-5c63f0836509 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:30.382414 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7d79ff02-6b96-4f9d-aaa3-5c63f0836509 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:30.389268 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d79ff02-6b96-4f9d-aaa3-5c63f0836509 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:30.389781 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d79ff02-6b96-4f9d-aaa3-5c63f0836509 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:30.390608 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d79ff02-6b96-4f9d-aaa3-5c63f0836509 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:30.391321 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7d79ff02-6b96-4f9d-aaa3-5c63f0836509 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:30.419043 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7d79ff02-6b96-4f9d-aaa3-5c63f0836509 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:22:30.504134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7d79ff02-6b96-4f9d-aaa3-5c63f0836509 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 204 len: 0 microversion: 2.1 time: 0.125821 Jul 12 13:22:30.505371 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 468/944] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:22:30 2022] DELETE /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:22:30.514119 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-56869d89-3a66-42a8-a24c-c4d88d94fc9a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:30.514864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-56869d89-3a66-42a8-a24c-c4d88d94fc9a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:30.522910 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-56869d89-3a66-42a8-a24c-c4d88d94fc9a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:30.523550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-56869d89-3a66-42a8-a24c-c4d88d94fc9a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:30.524462 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-56869d89-3a66-42a8-a24c-c4d88d94fc9a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:30.524981 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-56869d89-3a66-42a8-a24c-c4d88d94fc9a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:30.656321 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b13f30ef-0a91-481f-80ae-0eff90fd8238 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:30.657977 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b13f30ef-0a91-481f-80ae-0eff90fd8238 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:30.666707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b13f30ef-0a91-481f-80ae-0eff90fd8238 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:30.668202 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b13f30ef-0a91-481f-80ae-0eff90fd8238 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:30.669507 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b13f30ef-0a91-481f-80ae-0eff90fd8238 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:30.670187 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b13f30ef-0a91-481f-80ae-0eff90fd8238 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:30.850786 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b13f30ef-0a91-481f-80ae-0eff90fd8238 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:30.860551 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b13f30ef-0a91-481f-80ae-0eff90fd8238 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.210053 Jul 12 13:22:30.861302 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 469/945] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:30 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:31.120868 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-56869d89-3a66-42a8-a24c-c4d88d94fc9a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:31.131565 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-56869d89-3a66-42a8-a24c-c4d88d94fc9a tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1554 microversion: 2.1 time: 0.621589 Jul 12 13:22:31.132673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 477/946] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:30 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1554 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:22:31.877893 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7faf38ac-2571-4970-82f6-1e96ef596b0c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:31.879474 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7faf38ac-2571-4970-82f6-1e96ef596b0c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:31.885968 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7faf38ac-2571-4970-82f6-1e96ef596b0c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:31.886440 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7faf38ac-2571-4970-82f6-1e96ef596b0c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:31.888330 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7faf38ac-2571-4970-82f6-1e96ef596b0c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:31.888761 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7faf38ac-2571-4970-82f6-1e96ef596b0c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:32.108647 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-7faf38ac-2571-4970-82f6-1e96ef596b0c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:32.121039 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7faf38ac-2571-4970-82f6-1e96ef596b0c tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1562 microversion: 2.1 time: 0.247013 Jul 12 13:22:32.122134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 470/947] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:31 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1562 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:32.150483 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-313e2107-a308-4ced-81b5-14f376b2e406 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:32.151987 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-313e2107-a308-4ced-81b5-14f376b2e406 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:32.165000 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-313e2107-a308-4ced-81b5-14f376b2e406 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:32.167171 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-313e2107-a308-4ced-81b5-14f376b2e406 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:32.168550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-313e2107-a308-4ced-81b5-14f376b2e406 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:32.170683 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-313e2107-a308-4ced-81b5-14f376b2e406 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:32.433951 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-313e2107-a308-4ced-81b5-14f376b2e406 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:32.442451 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-313e2107-a308-4ced-81b5-14f376b2e406 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1554 microversion: 2.1 time: 0.296328 Jul 12 13:22:32.451712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 478/948] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:32 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1554 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:33.038944 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-b276c9bf-c174-413b-8c4b-416bc2a99926 req-f46b49cf-3651-4dad-9631-bf05b047f9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1b8589-d954-4806-9228-47ea80451712", "name": "network-vif-deleted", "tag": "22d70302-4120-482b-8c1c-525d7d7ba7f4"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:33.049169 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-b276c9bf-c174-413b-8c4b-416bc2a99926 req-f46b49cf-3651-4dad-9631-bf05b047f9fb service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:33.049848 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-b276c9bf-c174-413b-8c4b-416bc2a99926 req-f46b49cf-3651-4dad-9631-bf05b047f9fb service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:33.065056 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-b276c9bf-c174-413b-8c4b-416bc2a99926 req-f46b49cf-3651-4dad-9631-bf05b047f9fb service nova] Creating event network-vif-deleted:22d70302-4120-482b-8c1c-525d7d7ba7f4 for instance 5c1b8589-d954-4806-9228-47ea80451712 on hv-cinder-79760 Jul 12 13:22:33.071546 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-b276c9bf-c174-413b-8c4b-416bc2a99926 req-f46b49cf-3651-4dad-9631-bf05b047f9fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036191 Jul 12 13:22:33.072939 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 471/949] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:22:33.142191 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bcc0a542-37bf-4991-842b-67f4851f35cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:33.143967 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bcc0a542-37bf-4991-842b-67f4851f35cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:33.155874 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bcc0a542-37bf-4991-842b-67f4851f35cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:33.158177 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bcc0a542-37bf-4991-842b-67f4851f35cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:33.160044 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bcc0a542-37bf-4991-842b-67f4851f35cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:33.160706 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bcc0a542-37bf-4991-842b-67f4851f35cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:33.183374 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-8506cc2d-80ef-4482-83c8-8ca7aababae1 req-e85c7545-e770-49d3-a8cb-093a9caae4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace38168-9c22-45ee-9115-1dcc8f236117", "name": "network-vif-deleted", "tag": "2b671be9-4c90-497b-a3b6-75b9a1ced246"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:33.195460 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8506cc2d-80ef-4482-83c8-8ca7aababae1 req-e85c7545-e770-49d3-a8cb-093a9caae4ba service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:33.197611 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8506cc2d-80ef-4482-83c8-8ca7aababae1 req-e85c7545-e770-49d3-a8cb-093a9caae4ba service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:33.216434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-8506cc2d-80ef-4482-83c8-8ca7aababae1 req-e85c7545-e770-49d3-a8cb-093a9caae4ba service nova] Creating event network-vif-deleted:2b671be9-4c90-497b-a3b6-75b9a1ced246 for instance ace38168-9c22-45ee-9115-1dcc8f236117 on hv-cinder-79760 Jul 12 13:22:33.222549 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-8506cc2d-80ef-4482-83c8-8ca7aababae1 req-e85c7545-e770-49d3-a8cb-093a9caae4ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047347 Jul 12 13:22:33.227294 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 472/950] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:22:33.288996 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-bcc0a542-37bf-4991-842b-67f4851f35cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:33.305105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-bcc0a542-37bf-4991-842b-67f4851f35cd tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1217 microversion: 2.1 time: 0.169475 Jul 12 13:22:33.305864 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 479/951] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:33 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:33.462832 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:33.469153 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:33.492709 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:33.493566 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:33.494768 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:33.495413 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:33.545693 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:33.546139 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:33.546591 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lazy-loading 'fault' on Instance uuid ace38168-9c22-45ee-9115-1dcc8f236117 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:22:33.643998 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3bb2983cd4a4e27a73d46101fafea23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ba94948f8ed41e3a3a9052aa2320f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:33.648648 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:33.702743 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-970b2533-845d-4087-a633-814420d30330 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 200 len: 1348 microversion: 2.1 time: 0.245946 Jul 12 13:22:33.707198 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 473/952] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:33 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 1348 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:34.322712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:34.323602 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:34.340469 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:34.340983 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:34.343608 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:34.346139 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:34.408906 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:34.409740 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:34.410406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lazy-loading 'fault' on Instance uuid 5c1b8589-d954-4806-9228-47ea80451712 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:22:34.414422 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:34.508580 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2edc70216491fa7e2c4d2e28d050f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106ea1b5dcdf45a2a18fc882d8b49782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:34.516377 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-19b4bdff-965e-4805-b6eb-54d50d4bd72d tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 200 len: 1176 microversion: 2.1 time: 0.198072 Jul 12 13:22:34.521107 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 480/953] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:34 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 1176 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:34.725649 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:34.726313 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] [instance: ace38168-9c22-45ee-9115-1dcc8f236117] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:34.734751 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:34.735556 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:34.736299 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:34.736729 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:34.751377 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] HTTP exception thrown: Instance ace38168-9c22-45ee-9115-1dcc8f236117 could not be found. Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Request method failure captured: Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 HTTP/1.1 Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXTs61MgXY8xQv5n28v6ZClIuXewwxAHWDho2M3bS0mUdu2HrsMWEp1I4LyZvdfvphvVRUvEG9BenNevh1eNCZLt6gRpY2eVkEgsNylxnUVmW88OP6A0k5Q54OXJBjXiG_N0S1ztnMe4grhL3jfTef6uKOw9VpHVjuuN9397wHd8aB4 Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: 7ba94948f8ed41e3a3a9052aa2320f24 Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-TestMinimumBasicScenario-1675201192 Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:22:34.753063 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7ba94948f8ed41e3a3a9052aa2320f24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7ba94948f8ed41e3a3a9052aa2320f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ba94948f8ed41e3a3a9052aa2320f24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7ba94948f8ed41e3a3a9052aa2320f24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-TestMinimumBasicScenario-1675201192 Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 7ba94948f8ed41e3a3a9052aa2320f24 Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1675201192 Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-TestMinimumBasicScenario-1675201192-project Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: e3bb2983cd4a4e27a73d46101fafea23 Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-TestMinimumBasicScenario-1675201192-project Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance ace38168-9c22-45ee-9115-1dcc8f236117 could not be found. Jul 12 13:22:34.754874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': 'ace38168-9c22-45ee-9115-1dcc8f236117'} Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace38168-9c22-45ee-9115-1dcc8f236117 could not be found. Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:22:34.755872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace38168-9c22-45ee-9115-1dcc8f236117 could not be found. Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace38168-9c22-45ee-9115-1dcc8f236117 could not be found. Jul 12 13:22:34.757879 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:22:34.759266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Returning 404 to user: Instance ace38168-9c22-45ee-9115-1dcc8f236117 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:22:34.759266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d6b0babe-da95-4205-b188-efb8ffcf3832 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117" status: 404 len: 111 microversion: 2.1 time: 0.034919 Jul 12 13:22:34.763583 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-26820730-9dcc-4bf3-85c6-ef6217f54137 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] Calling method '.version_select at 0x7fd48cee0790>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:34.769819 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 474/954] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:34 2022] GET /compute/v2.1/servers/ace38168-9c22-45ee-9115-1dcc8f236117 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:22:34.786946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-26820730-9dcc-4bf3-85c6-ef6217f54137 tempest-TestMinimumBasicScenario-1675201192 tempest-TestMinimumBasicScenario-1675201192-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1438628514" status: 202 len: 0 microversion: 2.1 time: 0.026378 Jul 12 13:22:34.790645 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 481/955] 10.222.0.33 () {58 vars in 1271 bytes} [Tue Jul 12 13:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1438628514 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:22:34.950520 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-623fd074-5dc1-459f-af1a-9e6e415a6a71 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'create', calling method: .version_select at 0x7fd48d1b5dc0>, body: {"keypair": {"name": "tempest-keypair-965820670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmak1fLbuCMZY6td4oBtXAS7hBeYncfWuJRB1Z5KdMljuwxGgz8UY4BN1tQWDaoyiFuJ0tHN9SbVkEUb1TbhMXTtaDTPBslWUg7q9Lc4FRKkoXTS8Tv0a/trnfW5j5j8g=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:34.964750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-623fd074-5dc1-459f-af1a-9e6e415a6a71 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Getting quotas for project ea5e3f6292234dacb166b604e41b40e3. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:22:34.968610 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-623fd074-5dc1-459f-af1a-9e6e415a6a71 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Getting quotas for user 648010798a7441fc9af3c682db2bfdc7 and project ea5e3f6292234dacb166b604e41b40e3. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:22:34.993401 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-623fd074-5dc1-459f-af1a-9e6e415a6a71 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157474 Jul 12 13:22:34.994980 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 475/956] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:22:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:22:35.539044 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:35.539892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] [instance: 5c1b8589-d954-4806-9228-47ea80451712] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:35.547016 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:35.547832 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:35.548808 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:35.549240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:35.567777 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] HTTP exception thrown: Instance 5c1b8589-d954-4806-9228-47ea80451712 could not be found. Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Request method failure captured: Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 HTTP/1.1 Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXQXHy8QPLOlLbnvX2GYlY8LmuZnD2uqxTBRw1Un9RI8mESTVoez4H7KwqlazrnqbwG5MPOOYPFsRY9_XxQhXXSoybR6KU_96SVgO3uY3xvXMnmHEplgq3ed8Jh8OHa0m7kUzRH3s24r-NTf71q85YNwUzvTnXeTqRlmGyK9U1SYkAA Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 106ea1b5dcdf45a2a18fc882d8b49782 Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-TestShelveInstance-1919965637 Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:22:35.572566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/106ea1b5dcdf45a2a18fc882d8b49782"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_106ea1b5dcdf45a2a18fc882d8b49782"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/106ea1b5dcdf45a2a18fc882d8b49782"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/106ea1b5dcdf45a2a18fc882d8b49782"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-TestShelveInstance-1919965637 Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 106ea1b5dcdf45a2a18fc882d8b49782 Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-TestShelveInstance-1919965637 Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-TestShelveInstance-1919965637-project Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: e6a2edc70216491fa7e2c4d2e28d050f Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-TestShelveInstance-1919965637-project Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 5c1b8589-d954-4806-9228-47ea80451712 could not be found. Jul 12 13:22:35.574279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '5c1b8589-d954-4806-9228-47ea80451712'} Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1b8589-d954-4806-9228-47ea80451712 could not be found. Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:22:35.575214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1b8589-d954-4806-9228-47ea80451712 could not be found. Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1b8589-d954-4806-9228-47ea80451712 could not be found. Jul 12 13:22:35.576492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:22:35.578736 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Returning 404 to user: Instance 5c1b8589-d954-4806-9228-47ea80451712 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:22:35.578736 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-253f290c-3747-4c00-8572-8e2a4e239e0f tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712" status: 404 len: 111 microversion: 2.1 time: 0.042529 Jul 12 13:22:35.578736 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 482/957] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:35 2022] GET /compute/v2.1/servers/5c1b8589-d954-4806-9228-47ea80451712 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:22:35.811197 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e8924dc6-2088-437a-a62b-17edd8a65a56 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] Calling method '.version_select at 0x7fd48d4240d0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:35.863553 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e8924dc6-2088-437a-a62b-17edd8a65a56 tempest-TestShelveInstance-1919965637 tempest-TestShelveInstance-1919965637-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-98640609" status: 202 len: 0 microversion: 2.1 time: 0.057599 Jul 12 13:22:35.864159 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 476/958] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:22:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-98640609 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:22:37.857377 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-118608817", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1f27e34-3fdd-4c69-89b3-ea2a10c194a5"}], "security_groups": [{"name": "tempest-securitygroup--474010399"}], "key_name": "tempest-keypair-965820670", "user_data": "}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:38.140526 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] validate_networks() for [('f1f27e34-3fdd-4c69-89b3-ea2a10c194a5', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:22:39.319559 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:22:39.320204 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:22:39.320446 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:22:39.320854 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:22:39.321270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:22:39.340541 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:39.341785 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:39.342995 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:39.344494 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:39.373889 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Getting quotas for project ea5e3f6292234dacb166b604e41b40e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:22:39.380311 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Getting quotas for user 648010798a7441fc9af3c682db2bfdc7 and project ea5e3f6292234dacb166b604e41b40e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:22:39.399277 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:22:39.401502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:22:39.475566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-aa427c42-b103-4093-98b4-b86a0d6ff778 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.622894 Jul 12 13:22:39.481625 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 483/959] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:22:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:22:39.488016 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9c3bfdb2-f918-4c4b-a026-8541f7e8049e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:39.488631 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9c3bfdb2-f918-4c4b-a026-8541f7e8049e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:39.680812 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9c3bfdb2-f918-4c4b-a026-8541f7e8049e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:39.688588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9c3bfdb2-f918-4c4b-a026-8541f7e8049e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1236 microversion: 2.1 time: 0.205733 Jul 12 13:22:39.689977 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 477/960] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:39 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1236 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:40.709434 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f88f76a1-9bfa-4167-b728-2fdde896c01d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:40.711224 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f88f76a1-9bfa-4167-b728-2fdde896c01d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:40.722154 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f88f76a1-9bfa-4167-b728-2fdde896c01d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:40.730276 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f88f76a1-9bfa-4167-b728-2fdde896c01d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:40.731795 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f88f76a1-9bfa-4167-b728-2fdde896c01d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:40.733673 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f88f76a1-9bfa-4167-b728-2fdde896c01d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:40.956380 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f88f76a1-9bfa-4167-b728-2fdde896c01d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:40.973280 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f88f76a1-9bfa-4167-b728-2fdde896c01d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1296 microversion: 2.1 time: 0.269848 Jul 12 13:22:40.973937 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 484/961] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:40 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1296 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:41.990837 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-166abd99-a518-4b38-a19d-351fc1f20386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:41.991519 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-166abd99-a518-4b38-a19d-351fc1f20386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:41.998808 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-166abd99-a518-4b38-a19d-351fc1f20386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:41.999618 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-166abd99-a518-4b38-a19d-351fc1f20386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:42.000741 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-166abd99-a518-4b38-a19d-351fc1f20386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:42.001295 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-166abd99-a518-4b38-a19d-351fc1f20386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:42.076336 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-166abd99-a518-4b38-a19d-351fc1f20386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:42.087475 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-166abd99-a518-4b38-a19d-351fc1f20386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1294 microversion: 2.1 time: 0.100554 Jul 12 13:22:42.088057 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 478/962] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:41 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:43.105374 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-bd0d3bdb-0d2f-4788-93c8-90c60338bdc5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:43.106314 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-bd0d3bdb-0d2f-4788-93c8-90c60338bdc5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:43.113719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd0d3bdb-0d2f-4788-93c8-90c60338bdc5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:43.114452 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd0d3bdb-0d2f-4788-93c8-90c60338bdc5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:43.115561 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd0d3bdb-0d2f-4788-93c8-90c60338bdc5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:43.116332 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-bd0d3bdb-0d2f-4788-93c8-90c60338bdc5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:43.723682 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-bd0d3bdb-0d2f-4788-93c8-90c60338bdc5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:43.737880 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-bd0d3bdb-0d2f-4788-93c8-90c60338bdc5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.636005 Jul 12 13:22:43.748228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 485/963] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:43 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:44.537006 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-8db5519c-fee9-42ad-b2a0-4b2d13bdbe1c req-86a1734d-d21c-4037-9d7f-5f274aa004ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c8a8d8-c71e-4311-844b-2024fab89e92", "tag": "0ab07ba0-ff81-426a-a8c2-bcb447d11b87"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:44.563943 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8db5519c-fee9-42ad-b2a0-4b2d13bdbe1c req-86a1734d-d21c-4037-9d7f-5f274aa004ff service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:44.565213 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8db5519c-fee9-42ad-b2a0-4b2d13bdbe1c req-86a1734d-d21c-4037-9d7f-5f274aa004ff service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:44.603859 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-8db5519c-fee9-42ad-b2a0-4b2d13bdbe1c req-86a1734d-d21c-4037-9d7f-5f274aa004ff service nova] Creating event network-changed:0ab07ba0-ff81-426a-a8c2-bcb447d11b87 for instance 47c8a8d8-c71e-4311-844b-2024fab89e92 on hv-cinder-79760 Jul 12 13:22:44.611101 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-8db5519c-fee9-42ad-b2a0-4b2d13bdbe1c req-86a1734d-d21c-4037-9d7f-5f274aa004ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077348 Jul 12 13:22:44.613527 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 479/964] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:22:44.754787 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-102128b3-bb17-454b-920e-b6706ce2f2a0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:44.755444 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-102128b3-bb17-454b-920e-b6706ce2f2a0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:44.761778 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-102128b3-bb17-454b-920e-b6706ce2f2a0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:44.762228 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-102128b3-bb17-454b-920e-b6706ce2f2a0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:44.770484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-102128b3-bb17-454b-920e-b6706ce2f2a0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:44.771149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-102128b3-bb17-454b-920e-b6706ce2f2a0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:45.181697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-102128b3-bb17-454b-920e-b6706ce2f2a0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:45.190826 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-102128b3-bb17-454b-920e-b6706ce2f2a0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.439995 Jul 12 13:22:45.191762 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 486/965] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:44 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:46.209601 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9d51fbf8-31ed-48f5-919a-08cbd2dd7006 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:46.210302 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9d51fbf8-31ed-48f5-919a-08cbd2dd7006 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:46.227887 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d51fbf8-31ed-48f5-919a-08cbd2dd7006 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:46.228331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d51fbf8-31ed-48f5-919a-08cbd2dd7006 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:46.233659 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d51fbf8-31ed-48f5-919a-08cbd2dd7006 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:46.234115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9d51fbf8-31ed-48f5-919a-08cbd2dd7006 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:46.646439 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9d51fbf8-31ed-48f5-919a-08cbd2dd7006 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:46.663434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9d51fbf8-31ed-48f5-919a-08cbd2dd7006 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.458129 Jul 12 13:22:46.664499 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 480/966] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:46 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:47.682548 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-993cecaf-c9f5-435b-ac38-ed9a7c2381b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:47.683557 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-993cecaf-c9f5-435b-ac38-ed9a7c2381b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:47.687154 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:47.691171 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-993cecaf-c9f5-435b-ac38-ed9a7c2381b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:47.691843 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-993cecaf-c9f5-435b-ac38-ed9a7c2381b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:47.692807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-993cecaf-c9f5-435b-ac38-ed9a7c2381b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:47.693645 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-993cecaf-c9f5-435b-ac38-ed9a7c2381b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:48.021919 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-993cecaf-c9f5-435b-ac38-ed9a7c2381b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:48.031381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-993cecaf-c9f5-435b-ac38-ed9a7c2381b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.353782 Jul 12 13:22:48.032937 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 487/967] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:47 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:49.049725 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4edc876a-b50c-4bb7-81bb-29fe15f55b62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:49.050360 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4edc876a-b50c-4bb7-81bb-29fe15f55b62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:49.052360 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:49.057587 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4edc876a-b50c-4bb7-81bb-29fe15f55b62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:49.058203 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4edc876a-b50c-4bb7-81bb-29fe15f55b62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:49.059194 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4edc876a-b50c-4bb7-81bb-29fe15f55b62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:49.059636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4edc876a-b50c-4bb7-81bb-29fe15f55b62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:49.229147 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4edc876a-b50c-4bb7-81bb-29fe15f55b62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:49.238665 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4edc876a-b50c-4bb7-81bb-29fe15f55b62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.193532 Jul 12 13:22:49.239921 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 481/968] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:49 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:50.259031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ca01d528-d6e3-46af-8421-9de16945f97e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:50.259726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ca01d528-d6e3-46af-8421-9de16945f97e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:50.262880 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:50.263733 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=6 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:50.272164 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ca01d528-d6e3-46af-8421-9de16945f97e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:50.272755 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ca01d528-d6e3-46af-8421-9de16945f97e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:50.273898 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ca01d528-d6e3-46af-8421-9de16945f97e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:50.274515 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ca01d528-d6e3-46af-8421-9de16945f97e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:50.412905 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ca01d528-d6e3-46af-8421-9de16945f97e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:50.421273 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ca01d528-d6e3-46af-8421-9de16945f97e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.168612 Jul 12 13:22:50.421840 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 488/969] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:50 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:51.443845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bb223b8b-67a1-45c5-8704-cab16cfdf0ff tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:51.444702 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bb223b8b-67a1-45c5-8704-cab16cfdf0ff tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:51.447632 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=6 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:22:51.456034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bb223b8b-67a1-45c5-8704-cab16cfdf0ff tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:51.456467 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bb223b8b-67a1-45c5-8704-cab16cfdf0ff tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:51.457222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bb223b8b-67a1-45c5-8704-cab16cfdf0ff tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:51.457645 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bb223b8b-67a1-45c5-8704-cab16cfdf0ff tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:51.592073 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bb223b8b-67a1-45c5-8704-cab16cfdf0ff tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:51.601498 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bb223b8b-67a1-45c5-8704-cab16cfdf0ff tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.164476 Jul 12 13:22:51.602136 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 482/970] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:51 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:52.627459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e52606f0-36db-4c61-a7c8-c25ca7ca03d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:52.628055 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e52606f0-36db-4c61-a7c8-c25ca7ca03d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:52.636168 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e52606f0-36db-4c61-a7c8-c25ca7ca03d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:52.636613 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e52606f0-36db-4c61-a7c8-c25ca7ca03d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:52.637372 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e52606f0-36db-4c61-a7c8-c25ca7ca03d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:52.637800 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e52606f0-36db-4c61-a7c8-c25ca7ca03d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:52.769478 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e52606f0-36db-4c61-a7c8-c25ca7ca03d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:52.777858 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e52606f0-36db-4c61-a7c8-c25ca7ca03d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.156524 Jul 12 13:22:52.778721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 489/971] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:52 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:52.781553 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-507f9f8d-e9cb-4955-ae88-bead79a5e935 req-1f189060-3253-4f69-9f26-94d6e607abdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c8a8d8-c71e-4311-844b-2024fab89e92", "name": "network-vif-plugged", "status": "completed", "tag": "0ab07ba0-ff81-426a-a8c2-bcb447d11b87"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:52.791808 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-507f9f8d-e9cb-4955-ae88-bead79a5e935 req-1f189060-3253-4f69-9f26-94d6e607abdf service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:52.792252 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-507f9f8d-e9cb-4955-ae88-bead79a5e935 req-1f189060-3253-4f69-9f26-94d6e607abdf service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:52.804278 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-507f9f8d-e9cb-4955-ae88-bead79a5e935 req-1f189060-3253-4f69-9f26-94d6e607abdf service nova] Creating event network-vif-plugged:0ab07ba0-ff81-426a-a8c2-bcb447d11b87 for instance 47c8a8d8-c71e-4311-844b-2024fab89e92 on hv-cinder-79760 Jul 12 13:22:52.809137 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-507f9f8d-e9cb-4955-ae88-bead79a5e935 req-1f189060-3253-4f69-9f26-94d6e607abdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031966 Jul 12 13:22:52.809732 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 483/972] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:22:53.795502 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ac086c8e-797c-453f-b509-307715ac1f58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:53.796119 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-ac086c8e-797c-453f-b509-307715ac1f58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:53.803123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ac086c8e-797c-453f-b509-307715ac1f58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:53.803572 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ac086c8e-797c-453f-b509-307715ac1f58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:53.804338 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ac086c8e-797c-453f-b509-307715ac1f58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:53.804775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-ac086c8e-797c-453f-b509-307715ac1f58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:53.941083 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-ac086c8e-797c-453f-b509-307715ac1f58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:53.948572 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ac086c8e-797c-453f-b509-307715ac1f58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.157449 Jul 12 13:22:53.949291 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 490/973] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:53 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:54.972006 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-4f157b0e-1a4c-4194-be17-506ce32861ae tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:54.973093 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-4f157b0e-1a4c-4194-be17-506ce32861ae tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:54.983677 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f157b0e-1a4c-4194-be17-506ce32861ae tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:54.984402 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f157b0e-1a4c-4194-be17-506ce32861ae tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:54.985567 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f157b0e-1a4c-4194-be17-506ce32861ae tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:54.985990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-4f157b0e-1a4c-4194-be17-506ce32861ae tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:55.119405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-4f157b0e-1a4c-4194-be17-506ce32861ae tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:55.127164 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-4f157b0e-1a4c-4194-be17-506ce32861ae tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.163352 Jul 12 13:22:55.127707 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 484/974] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:54 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:56.145043 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9effe676-b021-4ed6-8774-035b16cb8bd0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:56.145645 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9effe676-b021-4ed6-8774-035b16cb8bd0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:56.152667 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9effe676-b021-4ed6-8774-035b16cb8bd0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:56.153108 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9effe676-b021-4ed6-8774-035b16cb8bd0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:56.153915 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9effe676-b021-4ed6-8774-035b16cb8bd0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:56.154336 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9effe676-b021-4ed6-8774-035b16cb8bd0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:56.289933 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9effe676-b021-4ed6-8774-035b16cb8bd0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:56.297830 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9effe676-b021-4ed6-8774-035b16cb8bd0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.156685 Jul 12 13:22:56.298394 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 491/975] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:56 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:57.319375 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-021de2e8-8fd9-4ee4-bb86-ddd4382c9f38 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:57.320341 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-021de2e8-8fd9-4ee4-bb86-ddd4382c9f38 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:57.330108 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-021de2e8-8fd9-4ee4-bb86-ddd4382c9f38 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:57.330545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-021de2e8-8fd9-4ee4-bb86-ddd4382c9f38 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:57.331350 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-021de2e8-8fd9-4ee4-bb86-ddd4382c9f38 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:57.331771 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-021de2e8-8fd9-4ee4-bb86-ddd4382c9f38 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:57.477062 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-021de2e8-8fd9-4ee4-bb86-ddd4382c9f38 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:57.485007 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-021de2e8-8fd9-4ee4-bb86-ddd4382c9f38 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1361 microversion: 2.1 time: 0.172173 Jul 12 13:22:57.491034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 485/976] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:57 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:58.503734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3a7da00b-0a6f-421a-b03c-97ee062d55bc tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:58.504332 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3a7da00b-0a6f-421a-b03c-97ee062d55bc tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:58.510860 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a7da00b-0a6f-421a-b03c-97ee062d55bc tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:58.511340 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a7da00b-0a6f-421a-b03c-97ee062d55bc tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:58.512107 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a7da00b-0a6f-421a-b03c-97ee062d55bc tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:58.512536 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a7da00b-0a6f-421a-b03c-97ee062d55bc tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:58.648308 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3a7da00b-0a6f-421a-b03c-97ee062d55bc tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:22:58.657505 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3a7da00b-0a6f-421a-b03c-97ee062d55bc tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1545 microversion: 2.1 time: 0.156869 Jul 12 13:22:58.657505 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 492/977] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:22:58 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1545 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:22:58.673585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-6ff8edd4-8f0e-4a26-bad7-663314659a4c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:22:58.674142 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-6ff8edd4-8f0e-4a26-bad7-663314659a4c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:22:58.681133 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ff8edd4-8f0e-4a26-bad7-663314659a4c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:58.681571 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ff8edd4-8f0e-4a26-bad7-663314659a4c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:58.682331 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ff8edd4-8f0e-4a26-bad7-663314659a4c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:58.682759 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-6ff8edd4-8f0e-4a26-bad7-663314659a4c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:58.763863 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-6ff8edd4-8f0e-4a26-bad7-663314659a4c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094558 Jul 12 13:22:58.764486 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 486/978] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 12 13:22:58 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:22:59.757193 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-bff28902-cd82-48f2-8087-5551d0655134 req-27157414-228f-4999-ba3e-969fa6f6864e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c8a8d8-c71e-4311-844b-2024fab89e92", "tag": "0ab07ba0-ff81-426a-a8c2-bcb447d11b87"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:22:59.766132 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-bff28902-cd82-48f2-8087-5551d0655134 req-27157414-228f-4999-ba3e-969fa6f6864e service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:22:59.766413 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-bff28902-cd82-48f2-8087-5551d0655134 req-27157414-228f-4999-ba3e-969fa6f6864e service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:22:59.778469 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-bff28902-cd82-48f2-8087-5551d0655134 req-27157414-228f-4999-ba3e-969fa6f6864e service nova] Creating event network-changed:0ab07ba0-ff81-426a-a8c2-bcb447d11b87 for instance 47c8a8d8-c71e-4311-844b-2024fab89e92 on hv-cinder-79760 Jul 12 13:22:59.785708 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-bff28902-cd82-48f2-8087-5551d0655134 req-27157414-228f-4999-ba3e-969fa6f6864e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032079 Jul 12 13:22:59.786744 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 493/979] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:23:29.896333 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=11 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:29.897445 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=46 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:29.901763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1185871190", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1629722949", "security_groups": [{"name": "tempest-secgroup-smoke-683362428"}], "block_device_mapping_v2": [{"uuid": "bd321b44-bb17-4043-8951-b99e208dc005", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "04848669-0add-4a7f-9670-bf6780611a41"}]}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:23:30.015982 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.network.neutron [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] validate_networks() for [('04848669-0add-4a7f-9670-bf6780611a41', None, None, None, None, None)] {{(pid=117963) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:23:30.730434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Flavor limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:23:30.730834 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Image limits 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:23:30.731324 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Flavor pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:23:30.731724 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Image pref 0:0:0 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:23:30.732122 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.virt.hardware [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117963) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:23:30.741636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:30.742199 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:30.743046 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:30.743476 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:30.762349 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Getting quotas for project e603fb53b07e43a2b529f59a02f687fc. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:23:30.766337 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Getting quotas for user 0d6f70302739437b8d14fc0fd7967dac and project e603fb53b07e43a2b529f59a02f687fc. Resources: {'cores', 'instances', 'ram'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:23:30.828906 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Going to run 1 instances... {{(pid=117963) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:23:30.830974 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd321b44-bb17-4043-8951-b99e208dc005',volume_size=None,volume_type=None)] {{(pid=117963) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:23:30.975659 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8e9afd89-1130-4614-a778-2e4d433d1868 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.080833 Jul 12 13:23:30.976634 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 487/980] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:23:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:23:30.984788 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=13 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:30.985641 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=62 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:30.990839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-049a8e18-e44f-40eb-b96d-702080329d6d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:30.991664 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-049a8e18-e44f-40eb-b96d-702080329d6d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:31.046151 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-049a8e18-e44f-40eb-b96d-702080329d6d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:31.053033 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-049a8e18-e44f-40eb-b96d-702080329d6d tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1095 microversion: 2.1 time: 0.070036 Jul 12 13:23:31.058438 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 494/981] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:30 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:32.070846 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-176a30ef-40f0-40bb-8aea-1be9520fa95a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:32.071491 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-176a30ef-40f0-40bb-8aea-1be9520fa95a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:32.128484 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-176a30ef-40f0-40bb-8aea-1be9520fa95a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:32.135866 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-176a30ef-40f0-40bb-8aea-1be9520fa95a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1095 microversion: 2.1 time: 0.069423 Jul 12 13:23:32.136457 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 488/982] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:32 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:33.153459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7e3f8527-828d-42c1-8ca2-151699c671e4 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:33.154889 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7e3f8527-828d-42c1-8ca2-151699c671e4 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:33.218186 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7e3f8527-828d-42c1-8ca2-151699c671e4 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:33.226060 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7e3f8527-828d-42c1-8ca2-151699c671e4 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1095 microversion: 2.1 time: 0.076840 Jul 12 13:23:33.226873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 495/983] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:33 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:34.243397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-eaa62d01-e66f-486d-93eb-d34f288b209a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:34.243994 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-eaa62d01-e66f-486d-93eb-d34f288b209a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:34.301190 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-eaa62d01-e66f-486d-93eb-d34f288b209a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:34.309828 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-eaa62d01-e66f-486d-93eb-d34f288b209a tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1095 microversion: 2.1 time: 0.070325 Jul 12 13:23:34.310418 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 489/984] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:34 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:35.327260 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4caee251-ce09-4673-97e4-a7c99c06bc4e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:35.327962 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4caee251-ce09-4673-97e4-a7c99c06bc4e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:35.335666 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4caee251-ce09-4673-97e4-a7c99c06bc4e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:35.336103 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4caee251-ce09-4673-97e4-a7c99c06bc4e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:35.336849 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4caee251-ce09-4673-97e4-a7c99c06bc4e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:35.337273 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4caee251-ce09-4673-97e4-a7c99c06bc4e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:35.404344 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4caee251-ce09-4673-97e4-a7c99c06bc4e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:35.412314 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4caee251-ce09-4673-97e4-a7c99c06bc4e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1145 microversion: 2.1 time: 0.089172 Jul 12 13:23:35.412870 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 496/985] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:35 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:36.430010 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bbe84697-35db-477d-8d2a-5ce54d295550 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:36.430639 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bbe84697-35db-477d-8d2a-5ce54d295550 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:36.439018 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbe84697-35db-477d-8d2a-5ce54d295550 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:36.439526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbe84697-35db-477d-8d2a-5ce54d295550 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:36.440355 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbe84697-35db-477d-8d2a-5ce54d295550 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:36.440765 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbe84697-35db-477d-8d2a-5ce54d295550 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:36.511109 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-bbe84697-35db-477d-8d2a-5ce54d295550 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:36.520393 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bbe84697-35db-477d-8d2a-5ce54d295550 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1201 microversion: 2.1 time: 0.094425 Jul 12 13:23:36.520976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 490/986] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:36 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:37.537280 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f8aa041d-9025-4d09-9590-36d8536b5284 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:37.537894 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f8aa041d-9025-4d09-9590-36d8536b5284 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:37.545660 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f8aa041d-9025-4d09-9590-36d8536b5284 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:37.546550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f8aa041d-9025-4d09-9590-36d8536b5284 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:37.547669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f8aa041d-9025-4d09-9590-36d8536b5284 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:37.548614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f8aa041d-9025-4d09-9590-36d8536b5284 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:37.781141 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f8aa041d-9025-4d09-9590-36d8536b5284 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:37.791205 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f8aa041d-9025-4d09-9590-36d8536b5284 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.257694 Jul 12 13:23:37.792221 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 497/987] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:37 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:38.021510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-fd9a3283-df39-4818-9a16-b04649bca2c5 req-9b1ff750-8692-4c77-89b5-1c4908f19d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1", "tag": "d470f6ed-02cc-4c43-a08c-b782931a9e5d"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:23:38.037995 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-fd9a3283-df39-4818-9a16-b04649bca2c5 req-9b1ff750-8692-4c77-89b5-1c4908f19d92 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:38.038417 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-fd9a3283-df39-4818-9a16-b04649bca2c5 req-9b1ff750-8692-4c77-89b5-1c4908f19d92 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:38.056606 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-fd9a3283-df39-4818-9a16-b04649bca2c5 req-9b1ff750-8692-4c77-89b5-1c4908f19d92 service nova] Creating event network-changed:d470f6ed-02cc-4c43-a08c-b782931a9e5d for instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 on hv-cinder-79760 Jul 12 13:23:38.062775 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-fd9a3283-df39-4818-9a16-b04649bca2c5 req-9b1ff750-8692-4c77-89b5-1c4908f19d92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046655 Jul 12 13:23:38.064168 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 491/988] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:23:38.809142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-24e9fa3e-fe70-4315-8044-930d0d70a957 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:38.809753 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-24e9fa3e-fe70-4315-8044-930d0d70a957 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:38.816853 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-24e9fa3e-fe70-4315-8044-930d0d70a957 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:38.817330 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-24e9fa3e-fe70-4315-8044-930d0d70a957 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:38.818080 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-24e9fa3e-fe70-4315-8044-930d0d70a957 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:38.818558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-24e9fa3e-fe70-4315-8044-930d0d70a957 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:39.048268 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-24e9fa3e-fe70-4315-8044-930d0d70a957 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:39.058095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-24e9fa3e-fe70-4315-8044-930d0d70a957 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.252740 Jul 12 13:23:39.058687 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 498/989] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:38 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:40.076792 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3a2f6104-4b9e-44a8-a998-83bd32f03ef7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:40.077518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3a2f6104-4b9e-44a8-a998-83bd32f03ef7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:40.084276 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3a2f6104-4b9e-44a8-a998-83bd32f03ef7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:40.084722 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3a2f6104-4b9e-44a8-a998-83bd32f03ef7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:40.085480 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3a2f6104-4b9e-44a8-a998-83bd32f03ef7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:40.085907 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3a2f6104-4b9e-44a8-a998-83bd32f03ef7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:40.225468 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3a2f6104-4b9e-44a8-a998-83bd32f03ef7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:40.235370 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3a2f6104-4b9e-44a8-a998-83bd32f03ef7 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.163076 Jul 12 13:23:40.236151 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 492/990] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:40 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:41.262231 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-10c518df-a233-4852-bff6-71332e8a56d6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:41.262932 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-10c518df-a233-4852-bff6-71332e8a56d6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:41.271437 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-10c518df-a233-4852-bff6-71332e8a56d6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:41.271981 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-10c518df-a233-4852-bff6-71332e8a56d6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:41.272959 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-10c518df-a233-4852-bff6-71332e8a56d6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:41.273396 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-10c518df-a233-4852-bff6-71332e8a56d6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:41.419011 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-10c518df-a233-4852-bff6-71332e8a56d6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:41.428527 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-10c518df-a233-4852-bff6-71332e8a56d6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.171266 Jul 12 13:23:41.429065 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 499/991] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:41 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:42.450222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e9e185d0-b280-4d87-a0f9-b8413999c211 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:42.451145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e9e185d0-b280-4d87-a0f9-b8413999c211 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:42.454028 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:42.461566 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e9e185d0-b280-4d87-a0f9-b8413999c211 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:42.462005 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e9e185d0-b280-4d87-a0f9-b8413999c211 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:42.462758 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e9e185d0-b280-4d87-a0f9-b8413999c211 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:42.463211 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e9e185d0-b280-4d87-a0f9-b8413999c211 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:42.617749 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e9e185d0-b280-4d87-a0f9-b8413999c211 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:42.629515 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e9e185d0-b280-4d87-a0f9-b8413999c211 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.185915 Jul 12 13:23:42.630084 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 493/992] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:42 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:43.648759 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9e91f099-4c6c-4bb0-b439-402379401369 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:43.649430 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9e91f099-4c6c-4bb0-b439-402379401369 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:43.652080 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=4 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:43.658582 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9e91f099-4c6c-4bb0-b439-402379401369 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:43.659127 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9e91f099-4c6c-4bb0-b439-402379401369 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:43.660001 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9e91f099-4c6c-4bb0-b439-402379401369 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:43.660504 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9e91f099-4c6c-4bb0-b439-402379401369 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:43.796554 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9e91f099-4c6c-4bb0-b439-402379401369 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:43.804479 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9e91f099-4c6c-4bb0-b439-402379401369 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.160280 Jul 12 13:23:43.805047 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 500/993] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:43 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:44.255357 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-7fdef4c7-e001-4b59-8567-5e871e87229e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:44.255867 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-7fdef4c7-e001-4b59-8567-5e871e87229e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:44.262641 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fdef4c7-e001-4b59-8567-5e871e87229e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:44.263111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fdef4c7-e001-4b59-8567-5e871e87229e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:44.263878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fdef4c7-e001-4b59-8567-5e871e87229e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:44.264296 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-7fdef4c7-e001-4b59-8567-5e871e87229e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:44.288940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-7fdef4c7-e001-4b59-8567-5e871e87229e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/ips" status: 200 len: 143 microversion: 2.1 time: 0.037565 Jul 12 13:23:44.289514 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 494/994] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:23:44 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/ips => generated 143 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:23:44.825937 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7b8ddb76-981b-40fe-8212-e2a7d4b439ab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:44.826791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7b8ddb76-981b-40fe-8212-e2a7d4b439ab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:44.837909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b8ddb76-981b-40fe-8212-e2a7d4b439ab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:44.838644 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b8ddb76-981b-40fe-8212-e2a7d4b439ab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:44.839934 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b8ddb76-981b-40fe-8212-e2a7d4b439ab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:44.840642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7b8ddb76-981b-40fe-8212-e2a7d4b439ab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:44.989418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7b8ddb76-981b-40fe-8212-e2a7d4b439ab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:44.997500 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7b8ddb76-981b-40fe-8212-e2a7d4b439ab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.178279 Jul 12 13:23:44.998033 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 501/995] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:44 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:46.017680 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9417a132-6194-4f80-a5f2-3053cf4fdf68 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:46.018546 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9417a132-6194-4f80-a5f2-3053cf4fdf68 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:46.020397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=10 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:23:46.026516 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9417a132-6194-4f80-a5f2-3053cf4fdf68 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:46.026982 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9417a132-6194-4f80-a5f2-3053cf4fdf68 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:46.027751 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9417a132-6194-4f80-a5f2-3053cf4fdf68 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:46.028185 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9417a132-6194-4f80-a5f2-3053cf4fdf68 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:46.174067 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9417a132-6194-4f80-a5f2-3053cf4fdf68 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:46.181940 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9417a132-6194-4f80-a5f2-3053cf4fdf68 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.168223 Jul 12 13:23:46.182521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 495/996] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:46 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:47.199693 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-37fe2653-a79b-4cd7-b835-ab4ab218b60c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:47.200311 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-37fe2653-a79b-4cd7-b835-ab4ab218b60c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:47.207149 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-37fe2653-a79b-4cd7-b835-ab4ab218b60c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:47.207590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-37fe2653-a79b-4cd7-b835-ab4ab218b60c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:47.208714 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-37fe2653-a79b-4cd7-b835-ab4ab218b60c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:47.209144 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-37fe2653-a79b-4cd7-b835-ab4ab218b60c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:47.342882 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-37fe2653-a79b-4cd7-b835-ab4ab218b60c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:47.350605 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-37fe2653-a79b-4cd7-b835-ab4ab218b60c tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.154870 Jul 12 13:23:47.351196 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 502/997] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:47 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:47.506261 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a9ff00c4-1ce2-422a-8316-0d346e113514 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "537f3ba3-bc8a-4432-8114-77d264cf3fac"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:23:47.507361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a9ff00c4-1ce2-422a-8316-0d346e113514 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:47.514240 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a9ff00c4-1ce2-422a-8316-0d346e113514 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:47.514685 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a9ff00c4-1ce2-422a-8316-0d346e113514 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:47.515475 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a9ff00c4-1ce2-422a-8316-0d346e113514 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:47.515901 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a9ff00c4-1ce2-422a-8316-0d346e113514 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:47.818391 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a9ff00c4-1ce2-422a-8316-0d346e113514 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316231 Jul 12 13:23:47.819290 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 496/998] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:23:47 2022] POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:23:47.936806 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-96fb9377-84db-4989-bd66-1a6faad984bb req-0de553ec-6bb8-4fce-95e8-8e685c5af5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1", "name": "network-vif-plugged", "status": "completed", "tag": "d470f6ed-02cc-4c43-a08c-b782931a9e5d"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:23:47.945791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-96fb9377-84db-4989-bd66-1a6faad984bb req-0de553ec-6bb8-4fce-95e8-8e685c5af5c4 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:47.946294 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-96fb9377-84db-4989-bd66-1a6faad984bb req-0de553ec-6bb8-4fce-95e8-8e685c5af5c4 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:47.959791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-96fb9377-84db-4989-bd66-1a6faad984bb req-0de553ec-6bb8-4fce-95e8-8e685c5af5c4 service nova] Creating event network-vif-plugged:d470f6ed-02cc-4c43-a08c-b782931a9e5d for instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 on hv-cinder-79760 Jul 12 13:23:47.965187 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-96fb9377-84db-4989-bd66-1a6faad984bb req-0de553ec-6bb8-4fce-95e8-8e685c5af5c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031912 Jul 12 13:23:47.966088 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 503/999] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:23:48.374044 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-99a73fbd-0cdf-4de5-9448-e51a5aeca199 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:48.375134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-99a73fbd-0cdf-4de5-9448-e51a5aeca199 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:48.385309 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99a73fbd-0cdf-4de5-9448-e51a5aeca199 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:48.385985 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99a73fbd-0cdf-4de5-9448-e51a5aeca199 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:48.387187 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99a73fbd-0cdf-4de5-9448-e51a5aeca199 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:48.387844 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-99a73fbd-0cdf-4de5-9448-e51a5aeca199 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:48.529746 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-99a73fbd-0cdf-4de5-9448-e51a5aeca199 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:48.537881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-99a73fbd-0cdf-4de5-9448-e51a5aeca199 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1266 microversion: 2.1 time: 0.171085 Jul 12 13:23:48.538419 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 497/1000] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:48 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:49.560671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-553178cc-9506-4da4-9218-a6b32a9d9b29 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:49.561509 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-553178cc-9506-4da4-9218-a6b32a9d9b29 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:49.569202 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-553178cc-9506-4da4-9218-a6b32a9d9b29 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:49.569710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-553178cc-9506-4da4-9218-a6b32a9d9b29 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:49.570426 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-553178cc-9506-4da4-9218-a6b32a9d9b29 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:49.570851 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-553178cc-9506-4da4-9218-a6b32a9d9b29 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:49.733171 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-553178cc-9506-4da4-9218-a6b32a9d9b29 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:49.742499 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-553178cc-9506-4da4-9218-a6b32a9d9b29 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1453 microversion: 2.1 time: 0.189035 Jul 12 13:23:49.743098 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 504/1001] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:49 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1453 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:23:49.766834 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-13729582-7441-4d60-a057-3a740d9d8cf8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:23:49.767524 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-13729582-7441-4d60-a057-3a740d9d8cf8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:23:49.774841 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13729582-7441-4d60-a057-3a740d9d8cf8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:49.775325 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13729582-7441-4d60-a057-3a740d9d8cf8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:49.776086 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13729582-7441-4d60-a057-3a740d9d8cf8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:49.776515 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-13729582-7441-4d60-a057-3a740d9d8cf8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:49.915023 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-13729582-7441-4d60-a057-3a740d9d8cf8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:23:49.925307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-13729582-7441-4d60-a057-3a740d9d8cf8 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1453 microversion: 2.1 time: 0.164726 Jul 12 13:23:49.925881 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 498/1002] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:23:49 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:23:51.773387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-7e9de3ce-0ceb-4cba-b890-3daa36e93c87 req-3ae40aa4-3a2a-4434-afa3-0c18a1123617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1", "tag": "d470f6ed-02cc-4c43-a08c-b782931a9e5d"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:23:51.782338 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-7e9de3ce-0ceb-4cba-b890-3daa36e93c87 req-3ae40aa4-3a2a-4434-afa3-0c18a1123617 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:23:51.783144 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-7e9de3ce-0ceb-4cba-b890-3daa36e93c87 req-3ae40aa4-3a2a-4434-afa3-0c18a1123617 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:23:51.796174 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-7e9de3ce-0ceb-4cba-b890-3daa36e93c87 req-3ae40aa4-3a2a-4434-afa3-0c18a1123617 service nova] Creating event network-changed:d470f6ed-02cc-4c43-a08c-b782931a9e5d for instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 on hv-cinder-79760 Jul 12 13:23:51.801558 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-7e9de3ce-0ceb-4cba-b890-3daa36e93c87 req-3ae40aa4-3a2a-4434-afa3-0c18a1123617 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031807 Jul 12 13:23:51.802160 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 505/1003] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:24:13.352483 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f67b3956-7cbc-45b4-96c9-ce0bb5f4bda8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:24:13.355177 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:13.355822 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:13.361615 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f67b3956-7cbc-45b4-96c9-ce0bb5f4bda8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:13.362091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f67b3956-7cbc-45b4-96c9-ce0bb5f4bda8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:13.422451 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f67b3956-7cbc-45b4-96c9-ce0bb5f4bda8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Going to try to stop instance {{(pid=117963) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 13:24:13.475381 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f67b3956-7cbc-45b4-96c9-ce0bb5f4bda8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/action" status: 202 len: 0 microversion: 2.1 time: 0.126859 Jul 12 13:24:13.475986 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 499/1004] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:24:13 2022] POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:24:13.482341 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=28 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:13.483068 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=52 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:24:13.487145 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-11c8a84f-edc3-4e9a-9534-3e9b4ab1b8a5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:13.487861 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-11c8a84f-edc3-4e9a-9534-3e9b4ab1b8a5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:13.495001 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-11c8a84f-edc3-4e9a-9534-3e9b4ab1b8a5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:13.495429 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-11c8a84f-edc3-4e9a-9534-3e9b4ab1b8a5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:13.496240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-11c8a84f-edc3-4e9a-9534-3e9b4ab1b8a5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:13.496707 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-11c8a84f-edc3-4e9a-9534-3e9b4ab1b8a5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:13.629166 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-11c8a84f-edc3-4e9a-9534-3e9b4ab1b8a5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:13.639196 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-11c8a84f-edc3-4e9a-9534-3e9b4ab1b8a5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.158229 Jul 12 13:24:13.639961 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 506/1005] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:13 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:24:14.662856 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-36340981-9d32-4e84-a8c9-55c2aa6a6723 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:14.664176 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-36340981-9d32-4e84-a8c9-55c2aa6a6723 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:14.675519 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36340981-9d32-4e84-a8c9-55c2aa6a6723 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:14.675966 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36340981-9d32-4e84-a8c9-55c2aa6a6723 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:14.676739 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36340981-9d32-4e84-a8c9-55c2aa6a6723 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:14.677170 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-36340981-9d32-4e84-a8c9-55c2aa6a6723 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:14.821242 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-36340981-9d32-4e84-a8c9-55c2aa6a6723 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:14.832424 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-36340981-9d32-4e84-a8c9-55c2aa6a6723 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.176252 Jul 12 13:24:14.833186 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 500/1006] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:14 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:15.850070 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d588f4bf-3771-4a62-b4b4-a3a6fe0be8a4 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:15.850669 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d588f4bf-3771-4a62-b4b4-a3a6fe0be8a4 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:15.857314 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d588f4bf-3771-4a62-b4b4-a3a6fe0be8a4 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:15.857757 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d588f4bf-3771-4a62-b4b4-a3a6fe0be8a4 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:15.858508 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d588f4bf-3771-4a62-b4b4-a3a6fe0be8a4 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:15.858930 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d588f4bf-3771-4a62-b4b4-a3a6fe0be8a4 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:16.005777 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d588f4bf-3771-4a62-b4b4-a3a6fe0be8a4 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:16.018089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d588f4bf-3771-4a62-b4b4-a3a6fe0be8a4 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.172021 Jul 12 13:24:16.018835 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 507/1007] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:15 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:17.035962 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8f79ba04-5a20-420a-b7f2-c38cdd26ca32 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:17.036589 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8f79ba04-5a20-420a-b7f2-c38cdd26ca32 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:17.042786 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f79ba04-5a20-420a-b7f2-c38cdd26ca32 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:17.043258 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f79ba04-5a20-420a-b7f2-c38cdd26ca32 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:17.044350 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f79ba04-5a20-420a-b7f2-c38cdd26ca32 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:17.044798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8f79ba04-5a20-420a-b7f2-c38cdd26ca32 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:17.193947 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8f79ba04-5a20-420a-b7f2-c38cdd26ca32 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:17.205067 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8f79ba04-5a20-420a-b7f2-c38cdd26ca32 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.173722 Jul 12 13:24:17.206516 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 501/1008] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:17 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:18.228031 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a84120b9-cc2f-46d9-a57a-c5a9b26b67ca tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:18.228982 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a84120b9-cc2f-46d9-a57a-c5a9b26b67ca tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:18.240441 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a84120b9-cc2f-46d9-a57a-c5a9b26b67ca tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:18.241032 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a84120b9-cc2f-46d9-a57a-c5a9b26b67ca tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:18.242196 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a84120b9-cc2f-46d9-a57a-c5a9b26b67ca tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:18.242754 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a84120b9-cc2f-46d9-a57a-c5a9b26b67ca tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:18.400962 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a84120b9-cc2f-46d9-a57a-c5a9b26b67ca tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:18.410624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a84120b9-cc2f-46d9-a57a-c5a9b26b67ca tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.188883 Jul 12 13:24:18.411326 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 508/1009] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:18 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:19.433655 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-2a44b84a-140f-49d2-bcfd-80019df2b59a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:19.434263 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-2a44b84a-140f-49d2-bcfd-80019df2b59a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:19.441912 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a44b84a-140f-49d2-bcfd-80019df2b59a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:19.442360 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a44b84a-140f-49d2-bcfd-80019df2b59a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:19.443120 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a44b84a-140f-49d2-bcfd-80019df2b59a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:19.443587 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-2a44b84a-140f-49d2-bcfd-80019df2b59a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:19.590242 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-2a44b84a-140f-49d2-bcfd-80019df2b59a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:19.598849 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-2a44b84a-140f-49d2-bcfd-80019df2b59a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.169257 Jul 12 13:24:19.599444 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 502/1010] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:19 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:20.616151 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3bca27ad-990d-4ff4-acb9-8da1fc69d9af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:20.616756 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3bca27ad-990d-4ff4-acb9-8da1fc69d9af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:20.623718 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3bca27ad-990d-4ff4-acb9-8da1fc69d9af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:20.624163 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3bca27ad-990d-4ff4-acb9-8da1fc69d9af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:20.624933 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3bca27ad-990d-4ff4-acb9-8da1fc69d9af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:20.625347 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3bca27ad-990d-4ff4-acb9-8da1fc69d9af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:20.770617 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-3bca27ad-990d-4ff4-acb9-8da1fc69d9af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:20.779771 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3bca27ad-990d-4ff4-acb9-8da1fc69d9af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.167581 Jul 12 13:24:20.780322 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 509/1011] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:20 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:21.803369 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-114effa9-5452-4493-b192-e5e9e167fe28 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:21.804845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-114effa9-5452-4493-b192-e5e9e167fe28 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:21.817923 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-114effa9-5452-4493-b192-e5e9e167fe28 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:21.818378 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-114effa9-5452-4493-b192-e5e9e167fe28 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:21.819178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-114effa9-5452-4493-b192-e5e9e167fe28 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:21.819606 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-114effa9-5452-4493-b192-e5e9e167fe28 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:21.961554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-114effa9-5452-4493-b192-e5e9e167fe28 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:21.970710 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-114effa9-5452-4493-b192-e5e9e167fe28 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.173787 Jul 12 13:24:21.971351 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 503/1012] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:21 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:22.990162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-f73152c8-f51b-489b-a017-178df1d8c86c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:22.990867 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-f73152c8-f51b-489b-a017-178df1d8c86c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:22.997946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f73152c8-f51b-489b-a017-178df1d8c86c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:22.998381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f73152c8-f51b-489b-a017-178df1d8c86c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:22.999314 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f73152c8-f51b-489b-a017-178df1d8c86c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:22.999738 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-f73152c8-f51b-489b-a017-178df1d8c86c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:23.129621 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-f73152c8-f51b-489b-a017-178df1d8c86c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:23.137738 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-f73152c8-f51b-489b-a017-178df1d8c86c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.152562 Jul 12 13:24:23.138298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 510/1013] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:22 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:24.154884 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0f3aa264-b2a6-46b0-b1e9-aac5671cb156 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:24.155539 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0f3aa264-b2a6-46b0-b1e9-aac5671cb156 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:24.163269 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f3aa264-b2a6-46b0-b1e9-aac5671cb156 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:24.163718 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f3aa264-b2a6-46b0-b1e9-aac5671cb156 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:24.164668 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f3aa264-b2a6-46b0-b1e9-aac5671cb156 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:24.165186 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0f3aa264-b2a6-46b0-b1e9-aac5671cb156 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:24.302565 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0f3aa264-b2a6-46b0-b1e9-aac5671cb156 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:24.311168 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0f3aa264-b2a6-46b0-b1e9-aac5671cb156 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.160093 Jul 12 13:24:24.311709 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 504/1014] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:24 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:25.328778 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-acac14bf-c9d8-4ee9-ae1b-866eb7c84dad tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:25.329373 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-acac14bf-c9d8-4ee9-ae1b-866eb7c84dad tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:25.336486 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acac14bf-c9d8-4ee9-ae1b-866eb7c84dad tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:25.336944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acac14bf-c9d8-4ee9-ae1b-866eb7c84dad tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:25.337729 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acac14bf-c9d8-4ee9-ae1b-866eb7c84dad tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:25.338162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-acac14bf-c9d8-4ee9-ae1b-866eb7c84dad tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:25.474264 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-acac14bf-c9d8-4ee9-ae1b-866eb7c84dad tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:25.483040 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-acac14bf-c9d8-4ee9-ae1b-866eb7c84dad tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.158156 Jul 12 13:24:25.483552 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 511/1015] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:25 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:26.501450 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-0e66afe0-065a-4fc3-be2a-7e72feb30a22 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:26.502299 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-0e66afe0-065a-4fc3-be2a-7e72feb30a22 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:26.511888 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e66afe0-065a-4fc3-be2a-7e72feb30a22 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:26.512327 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e66afe0-065a-4fc3-be2a-7e72feb30a22 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:26.513085 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e66afe0-065a-4fc3-be2a-7e72feb30a22 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:26.513518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-0e66afe0-065a-4fc3-be2a-7e72feb30a22 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:26.679672 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-0e66afe0-065a-4fc3-be2a-7e72feb30a22 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:26.690097 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-0e66afe0-065a-4fc3-be2a-7e72feb30a22 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.193854 Jul 12 13:24:26.699887 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 505/1016] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:26 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:27.711886 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a981e096-9e2d-4ff4-b6a4-31a9458cee3a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:27.712844 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a981e096-9e2d-4ff4-b6a4-31a9458cee3a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:27.722903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a981e096-9e2d-4ff4-b6a4-31a9458cee3a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:27.723381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a981e096-9e2d-4ff4-b6a4-31a9458cee3a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:27.724135 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a981e096-9e2d-4ff4-b6a4-31a9458cee3a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:27.724567 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a981e096-9e2d-4ff4-b6a4-31a9458cee3a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:27.873628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a981e096-9e2d-4ff4-b6a4-31a9458cee3a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:27.883373 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a981e096-9e2d-4ff4-b6a4-31a9458cee3a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.178157 Jul 12 13:24:27.883944 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 512/1017] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:27 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:28.904585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8753441b-77b2-49ec-9e3f-92896688b3e8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:28.905612 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8753441b-77b2-49ec-9e3f-92896688b3e8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:28.916453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8753441b-77b2-49ec-9e3f-92896688b3e8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:28.920469 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8753441b-77b2-49ec-9e3f-92896688b3e8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:28.920469 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8753441b-77b2-49ec-9e3f-92896688b3e8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:28.920469 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8753441b-77b2-49ec-9e3f-92896688b3e8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:29.070254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8753441b-77b2-49ec-9e3f-92896688b3e8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:29.084102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8753441b-77b2-49ec-9e3f-92896688b3e8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.185687 Jul 12 13:24:29.084979 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 506/1018] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:28 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:30.110612 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-131871d4-d5a6-44fe-b558-7a2ccf1eb09d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:30.111782 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-131871d4-d5a6-44fe-b558-7a2ccf1eb09d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:30.121895 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-131871d4-d5a6-44fe-b558-7a2ccf1eb09d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:30.122649 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-131871d4-d5a6-44fe-b558-7a2ccf1eb09d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:30.123958 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-131871d4-d5a6-44fe-b558-7a2ccf1eb09d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:30.124708 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-131871d4-d5a6-44fe-b558-7a2ccf1eb09d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:30.262263 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-131871d4-d5a6-44fe-b558-7a2ccf1eb09d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:30.270718 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-131871d4-d5a6-44fe-b558-7a2ccf1eb09d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.166790 Jul 12 13:24:30.271299 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 513/1019] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:30 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:31.290994 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a025af09-e33f-41ed-8499-48b89299b02b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:31.291786 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-a025af09-e33f-41ed-8499-48b89299b02b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:31.301339 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a025af09-e33f-41ed-8499-48b89299b02b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:31.301930 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a025af09-e33f-41ed-8499-48b89299b02b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:31.303022 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a025af09-e33f-41ed-8499-48b89299b02b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:31.303585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-a025af09-e33f-41ed-8499-48b89299b02b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:31.446003 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-a025af09-e33f-41ed-8499-48b89299b02b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:31.458158 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a025af09-e33f-41ed-8499-48b89299b02b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.171993 Jul 12 13:24:31.458907 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 507/1020] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:31 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:32.479543 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-2c228c39-3f3b-4e37-bc24-72559b46b43d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:32.481459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-2c228c39-3f3b-4e37-bc24-72559b46b43d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:32.490427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c228c39-3f3b-4e37-bc24-72559b46b43d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:32.490873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c228c39-3f3b-4e37-bc24-72559b46b43d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:32.491709 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c228c39-3f3b-4e37-bc24-72559b46b43d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:32.492141 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-2c228c39-3f3b-4e37-bc24-72559b46b43d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:32.633284 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-2c228c39-3f3b-4e37-bc24-72559b46b43d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:32.641765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-2c228c39-3f3b-4e37-bc24-72559b46b43d tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.169037 Jul 12 13:24:32.642161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 514/1021] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:32 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:33.662115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-934bee03-efec-4e64-8f60-3d453e77f892 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:33.662847 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-934bee03-efec-4e64-8f60-3d453e77f892 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:33.673092 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-934bee03-efec-4e64-8f60-3d453e77f892 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:33.673733 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-934bee03-efec-4e64-8f60-3d453e77f892 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:33.674769 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-934bee03-efec-4e64-8f60-3d453e77f892 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:33.675219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-934bee03-efec-4e64-8f60-3d453e77f892 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:33.809099 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-934bee03-efec-4e64-8f60-3d453e77f892 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:33.817521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-934bee03-efec-4e64-8f60-3d453e77f892 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.161144 Jul 12 13:24:33.818086 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 508/1022] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:33 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:34.834643 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a94c35cd-2eec-478f-bdeb-8a640a2cddc3 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:34.835275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a94c35cd-2eec-478f-bdeb-8a640a2cddc3 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:34.842418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a94c35cd-2eec-478f-bdeb-8a640a2cddc3 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:34.842861 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a94c35cd-2eec-478f-bdeb-8a640a2cddc3 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:34.843668 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a94c35cd-2eec-478f-bdeb-8a640a2cddc3 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:34.844100 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a94c35cd-2eec-478f-bdeb-8a640a2cddc3 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:34.988152 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a94c35cd-2eec-478f-bdeb-8a640a2cddc3 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:34.996306 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a94c35cd-2eec-478f-bdeb-8a640a2cddc3 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.166122 Jul 12 13:24:34.996870 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 515/1023] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:34 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:36.017617 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-8662df4d-f292-4326-977e-3c7bba258386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:36.018558 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-8662df4d-f292-4326-977e-3c7bba258386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:36.029494 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8662df4d-f292-4326-977e-3c7bba258386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:36.030187 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8662df4d-f292-4326-977e-3c7bba258386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:36.031419 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8662df4d-f292-4326-977e-3c7bba258386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:36.032116 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-8662df4d-f292-4326-977e-3c7bba258386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:36.169316 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-8662df4d-f292-4326-977e-3c7bba258386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:36.177417 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-8662df4d-f292-4326-977e-3c7bba258386 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1719 microversion: 2.1 time: 0.166138 Jul 12 13:24:36.178001 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 509/1024] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:36 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:37.198464 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7111cd67-01a8-4976-9bf3-cb32ad16f1fb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:37.199444 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7111cd67-01a8-4976-9bf3-cb32ad16f1fb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:37.209084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7111cd67-01a8-4976-9bf3-cb32ad16f1fb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:37.209524 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7111cd67-01a8-4976-9bf3-cb32ad16f1fb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:37.210275 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7111cd67-01a8-4976-9bf3-cb32ad16f1fb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:37.210697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7111cd67-01a8-4976-9bf3-cb32ad16f1fb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:37.346338 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7111cd67-01a8-4976-9bf3-cb32ad16f1fb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:37.355132 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7111cd67-01a8-4976-9bf3-cb32ad16f1fb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1696 microversion: 2.1 time: 0.163152 Jul 12 13:24:37.355667 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 516/1025] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:37 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:37.371651 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ece570da-9c39-4b29-9108-aca2a421e3cf tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:24:37.378463 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ece570da-9c39-4b29-9108-aca2a421e3cf tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:37.379189 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ece570da-9c39-4b29-9108-aca2a421e3cf tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:37.401667 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ece570da-9c39-4b29-9108-aca2a421e3cf tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Going to try to start instance {{(pid=117963) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 13:24:37.449529 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ece570da-9c39-4b29-9108-aca2a421e3cf tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/action" status: 202 len: 0 microversion: 2.1 time: 0.081506 Jul 12 13:24:37.450134 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 510/1026] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:24:37 2022] POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:24:37.459472 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7db5711c-5497-4300-a559-ab529626b4ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:37.460073 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-7db5711c-5497-4300-a559-ab529626b4ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:37.466412 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7db5711c-5497-4300-a559-ab529626b4ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:37.466863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7db5711c-5497-4300-a559-ab529626b4ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:37.467733 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7db5711c-5497-4300-a559-ab529626b4ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:37.468191 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-7db5711c-5497-4300-a559-ab529626b4ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:37.620942 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-7db5711c-5497-4300-a559-ab529626b4ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:37.630116 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7db5711c-5497-4300-a559-ab529626b4ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1705 microversion: 2.1 time: 0.174362 Jul 12 13:24:37.630787 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 517/1027] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:37 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1705 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:38.650518 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e393f9b5-6a92-4def-9747-246566353406 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:38.651214 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e393f9b5-6a92-4def-9747-246566353406 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:38.657702 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e393f9b5-6a92-4def-9747-246566353406 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:38.658133 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e393f9b5-6a92-4def-9747-246566353406 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:38.658892 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e393f9b5-6a92-4def-9747-246566353406 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:38.659352 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e393f9b5-6a92-4def-9747-246566353406 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:38.797471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e393f9b5-6a92-4def-9747-246566353406 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:38.806204 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e393f9b5-6a92-4def-9747-246566353406 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1705 microversion: 2.1 time: 0.160562 Jul 12 13:24:38.806787 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 511/1028] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:38 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1705 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:24:39.827195 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c725b83c-e299-4d64-97f0-99af55d170af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:24:39.828138 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c725b83c-e299-4d64-97f0-99af55d170af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:24:39.836979 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c725b83c-e299-4d64-97f0-99af55d170af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:39.837423 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c725b83c-e299-4d64-97f0-99af55d170af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:39.838179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c725b83c-e299-4d64-97f0-99af55d170af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:24:39.838611 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c725b83c-e299-4d64-97f0-99af55d170af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:24:39.978145 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-c725b83c-e299-4d64-97f0-99af55d170af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:24:39.986391 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c725b83c-e299-4d64-97f0-99af55d170af tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1709 microversion: 2.1 time: 0.165759 Jul 12 13:24:39.986974 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 518/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:24:39 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:13.063521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c630b6e8-88f4-4872-9f86-6661bca3ff91 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:13.064204 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c630b6e8-88f4-4872-9f86-6661bca3ff91 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:13.067820 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=26 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:13.068851 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:13.077681 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c630b6e8-88f4-4872-9f86-6661bca3ff91 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:13.078213 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c630b6e8-88f4-4872-9f86-6661bca3ff91 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:13.079228 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c630b6e8-88f4-4872-9f86-6661bca3ff91 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:13.079814 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c630b6e8-88f4-4872-9f86-6661bca3ff91 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:13.433927 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.objects.instance [None req-c630b6e8-88f4-4872-9f86-6661bca3ff91 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lazy-loading 'services' on Instance uuid 47c8a8d8-c71e-4311-844b-2024fab89e92 {{(pid=117963) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:25:13.511545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c630b6e8-88f4-4872-9f86-6661bca3ff91 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "DELETE /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/os-volume_attachments/537f3ba3-bc8a-4432-8114-77d264cf3fac" status: 202 len: 0 microversion: 2.1 time: 0.453590 Jul 12 13:25:13.512196 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 512/1030] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:25:13 2022] DELETE /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/os-volume_attachments/537f3ba3-bc8a-4432-8114-77d264cf3fac => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:25:14.650656 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e93840c5-a51a-43a1-828e-ff3468b41989 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:25:14.653187 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=26 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:14.653896 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=78 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:14.660311 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e93840c5-a51a-43a1-828e-ff3468b41989 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:14.660815 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e93840c5-a51a-43a1-828e-ff3468b41989 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:14.725571 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e93840c5-a51a-43a1-828e-ff3468b41989 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Going to try to stop instance {{(pid=117962) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 13:25:14.778114 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e93840c5-a51a-43a1-828e-ff3468b41989 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/action" status: 202 len: 0 microversion: 2.1 time: 0.134704 Jul 12 13:25:14.778711 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 519/1031] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:25:14 2022] POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:25:14.787589 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-171e6eca-845e-4daa-a228-9e1ebacb1018 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:14.788932 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-171e6eca-845e-4daa-a228-9e1ebacb1018 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:14.796390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-171e6eca-845e-4daa-a228-9e1ebacb1018 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:14.796843 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-171e6eca-845e-4daa-a228-9e1ebacb1018 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:14.797600 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-171e6eca-845e-4daa-a228-9e1ebacb1018 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:14.798028 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-171e6eca-845e-4daa-a228-9e1ebacb1018 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:14.934607 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-171e6eca-845e-4daa-a228-9e1ebacb1018 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:14.942692 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-171e6eca-845e-4daa-a228-9e1ebacb1018 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1673 microversion: 2.1 time: 0.159522 Jul 12 13:25:14.943298 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 513/1032] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:14 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:15.967002 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-8a421cae-7561-491a-b28f-be9447a5462f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:15.968105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-8a421cae-7561-491a-b28f-be9447a5462f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:15.979353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8a421cae-7561-491a-b28f-be9447a5462f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:15.979807 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8a421cae-7561-491a-b28f-be9447a5462f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:15.980573 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8a421cae-7561-491a-b28f-be9447a5462f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:15.981008 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-8a421cae-7561-491a-b28f-be9447a5462f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:16.257417 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-8a421cae-7561-491a-b28f-be9447a5462f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:16.266459 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-8a421cae-7561-491a-b28f-be9447a5462f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1673 microversion: 2.1 time: 0.307296 Jul 12 13:25:16.267341 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 520/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:15 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1673 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:16.655614 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:25:16.656184 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Tue Jul 12 13:25:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:25:17.285765 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-17422a49-b2af-4298-9321-222ba7ecac7b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:17.286690 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-17422a49-b2af-4298-9321-222ba7ecac7b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:17.293505 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17422a49-b2af-4298-9321-222ba7ecac7b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:17.294986 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17422a49-b2af-4298-9321-222ba7ecac7b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:17.295850 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17422a49-b2af-4298-9321-222ba7ecac7b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:17.296287 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-17422a49-b2af-4298-9321-222ba7ecac7b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:17.309528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:25:17.310037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Tue Jul 12 13:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:25:17.429443 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-17422a49-b2af-4298-9321-222ba7ecac7b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:17.437675 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-17422a49-b2af-4298-9321-222ba7ecac7b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1673 microversion: 2.1 time: 0.155942 Jul 12 13:25:17.438241 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 514/1034] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:17 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:18.462648 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9f9c68b9-d7c2-4c60-9274-98b1cb25bb97 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:18.463492 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-9f9c68b9-d7c2-4c60-9274-98b1cb25bb97 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:18.471512 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9f9c68b9-d7c2-4c60-9274-98b1cb25bb97 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:18.471953 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9f9c68b9-d7c2-4c60-9274-98b1cb25bb97 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:18.472729 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9f9c68b9-d7c2-4c60-9274-98b1cb25bb97 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:18.473153 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-9f9c68b9-d7c2-4c60-9274-98b1cb25bb97 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:18.609753 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-9f9c68b9-d7c2-4c60-9274-98b1cb25bb97 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:18.617881 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9f9c68b9-d7c2-4c60-9274-98b1cb25bb97 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1673 microversion: 2.1 time: 0.161422 Jul 12 13:25:18.618475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 521/1035] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:18 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:19.638091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e4264399-d61f-4c04-852d-18942017a524 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:19.638712 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-e4264399-d61f-4c04-852d-18942017a524 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:19.645880 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e4264399-d61f-4c04-852d-18942017a524 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:19.646332 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e4264399-d61f-4c04-852d-18942017a524 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:19.647121 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e4264399-d61f-4c04-852d-18942017a524 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:19.647577 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-e4264399-d61f-4c04-852d-18942017a524 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:19.779423 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-e4264399-d61f-4c04-852d-18942017a524 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:19.787545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e4264399-d61f-4c04-852d-18942017a524 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1673 microversion: 2.1 time: 0.155595 Jul 12 13:25:19.788091 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 515/1036] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:19 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:20.809306 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-354c82a8-6b54-47e9-9f36-fa7c0c2c3fc8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:20.810312 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-354c82a8-6b54-47e9-9f36-fa7c0c2c3fc8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:20.818383 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-354c82a8-6b54-47e9-9f36-fa7c0c2c3fc8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:20.818904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-354c82a8-6b54-47e9-9f36-fa7c0c2c3fc8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:20.819847 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-354c82a8-6b54-47e9-9f36-fa7c0c2c3fc8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:20.820361 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-354c82a8-6b54-47e9-9f36-fa7c0c2c3fc8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:20.958402 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-354c82a8-6b54-47e9-9f36-fa7c0c2c3fc8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:20.966976 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-354c82a8-6b54-47e9-9f36-fa7c0c2c3fc8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1673 microversion: 2.1 time: 0.164113 Jul 12 13:25:20.967537 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 522/1037] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:20 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:21.987216 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3f544b59-d309-44c6-8c68-925d2aa32e20 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:21.987939 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3f544b59-d309-44c6-8c68-925d2aa32e20 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:21.996585 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f544b59-d309-44c6-8c68-925d2aa32e20 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:21.997136 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f544b59-d309-44c6-8c68-925d2aa32e20 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:21.998041 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f544b59-d309-44c6-8c68-925d2aa32e20 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:21.998590 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3f544b59-d309-44c6-8c68-925d2aa32e20 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:22.144369 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-3f544b59-d309-44c6-8c68-925d2aa32e20 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:22.152158 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3f544b59-d309-44c6-8c68-925d2aa32e20 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1673 microversion: 2.1 time: 0.170006 Jul 12 13:25:22.152700 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 516/1038] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:21 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:23.174311 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-14b5e774-44d5-48e6-889f-8b84c413ef53 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:23.175134 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-14b5e774-44d5-48e6-889f-8b84c413ef53 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:23.185014 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-14b5e774-44d5-48e6-889f-8b84c413ef53 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:23.185614 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-14b5e774-44d5-48e6-889f-8b84c413ef53 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:23.186719 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-14b5e774-44d5-48e6-889f-8b84c413ef53 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:23.187384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-14b5e774-44d5-48e6-889f-8b84c413ef53 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:23.332079 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-14b5e774-44d5-48e6-889f-8b84c413ef53 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:23.340089 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-14b5e774-44d5-48e6-889f-8b84c413ef53 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1673 microversion: 2.1 time: 0.172714 Jul 12 13:25:23.340696 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 523/1039] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:23 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:24.362596 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f157110a-5f99-40d8-aa77-87f25695f36c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:24.363743 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f157110a-5f99-40d8-aa77-87f25695f36c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:24.374390 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f157110a-5f99-40d8-aa77-87f25695f36c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:24.374835 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f157110a-5f99-40d8-aa77-87f25695f36c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:24.375624 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f157110a-5f99-40d8-aa77-87f25695f36c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:24.376054 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f157110a-5f99-40d8-aa77-87f25695f36c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:24.515477 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-f157110a-5f99-40d8-aa77-87f25695f36c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:24.523076 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f157110a-5f99-40d8-aa77-87f25695f36c tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1673 microversion: 2.1 time: 0.167928 Jul 12 13:25:24.523646 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 517/1040] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:24 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:25.545307 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e0a5730f-a414-4ce4-91c6-542ee2838b8b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:25.545932 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e0a5730f-a414-4ce4-91c6-542ee2838b8b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:25.554069 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0a5730f-a414-4ce4-91c6-542ee2838b8b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:25.554589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0a5730f-a414-4ce4-91c6-542ee2838b8b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:25.555503 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0a5730f-a414-4ce4-91c6-542ee2838b8b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:25.556003 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e0a5730f-a414-4ce4-91c6-542ee2838b8b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:25.697613 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-e0a5730f-a414-4ce4-91c6-542ee2838b8b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:25.706465 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e0a5730f-a414-4ce4-91c6-542ee2838b8b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1650 microversion: 2.1 time: 0.168110 Jul 12 13:25:25.707082 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 524/1041] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:25 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1650 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:25.723133 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-246c55bc-73f9-48c4-b9f9-feac7ae18c58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:25:25.730021 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-246c55bc-73f9-48c4-b9f9-feac7ae18c58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:25.730464 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-246c55bc-73f9-48c4-b9f9-feac7ae18c58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:25.753053 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-246c55bc-73f9-48c4-b9f9-feac7ae18c58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Going to try to start instance {{(pid=117963) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 13:25:25.802364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-246c55bc-73f9-48c4-b9f9-feac7ae18c58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/action" status: 202 len: 0 microversion: 2.1 time: 0.082530 Jul 12 13:25:25.802890 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 518/1042] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Jul 12 13:25:25 2022] POST /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:25:25.812280 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a2719cc9-9592-45a5-976b-b3aa2699f270 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:25.812888 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a2719cc9-9592-45a5-976b-b3aa2699f270 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:25.819193 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2719cc9-9592-45a5-976b-b3aa2699f270 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:25.819635 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2719cc9-9592-45a5-976b-b3aa2699f270 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:25.820521 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2719cc9-9592-45a5-976b-b3aa2699f270 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:25.820951 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a2719cc9-9592-45a5-976b-b3aa2699f270 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:25.983946 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a2719cc9-9592-45a5-976b-b3aa2699f270 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:25.992019 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a2719cc9-9592-45a5-976b-b3aa2699f270 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1659 microversion: 2.1 time: 0.183900 Jul 12 13:25:25.992624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 525/1043] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:25 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1659 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:27.014990 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dc7a0265-7d3e-413d-bea3-ac6a0c3b7c12 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:27.015793 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dc7a0265-7d3e-413d-bea3-ac6a0c3b7c12 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:27.023008 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dc7a0265-7d3e-413d-bea3-ac6a0c3b7c12 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:27.023538 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dc7a0265-7d3e-413d-bea3-ac6a0c3b7c12 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:27.024391 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dc7a0265-7d3e-413d-bea3-ac6a0c3b7c12 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:27.024872 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dc7a0265-7d3e-413d-bea3-ac6a0c3b7c12 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:27.163259 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-dc7a0265-7d3e-413d-bea3-ac6a0c3b7c12 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:27.171374 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dc7a0265-7d3e-413d-bea3-ac6a0c3b7c12 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1663 microversion: 2.1 time: 0.163597 Jul 12 13:25:27.172059 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 519/1044] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:27 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:31.749903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3a9b79ad-73e5-44c3-90d6-ff8ecdcdb1ec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:31.751127 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3a9b79ad-73e5-44c3-90d6-ff8ecdcdb1ec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:31.751658 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-ade42a08-9cbd-481f-a773-f1b76f9c9794 req-c05dbb83-e554-4396-b684-17c7ba52094c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1", "tag": "d470f6ed-02cc-4c43-a08c-b782931a9e5d"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:25:31.758109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a9b79ad-73e5-44c3-90d6-ff8ecdcdb1ec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:31.758640 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a9b79ad-73e5-44c3-90d6-ff8ecdcdb1ec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:31.759501 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a9b79ad-73e5-44c3-90d6-ff8ecdcdb1ec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:31.760001 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3a9b79ad-73e5-44c3-90d6-ff8ecdcdb1ec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:31.760239 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ade42a08-9cbd-481f-a773-f1b76f9c9794 req-c05dbb83-e554-4396-b684-17c7ba52094c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:31.760669 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-ade42a08-9cbd-481f-a773-f1b76f9c9794 req-c05dbb83-e554-4396-b684-17c7ba52094c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:31.771932 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-ade42a08-9cbd-481f-a773-f1b76f9c9794 req-c05dbb83-e554-4396-b684-17c7ba52094c service nova] Creating event network-changed:d470f6ed-02cc-4c43-a08c-b782931a9e5d for instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 on hv-cinder-79760 Jul 12 13:25:31.777449 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-ade42a08-9cbd-481f-a773-f1b76f9c9794 req-c05dbb83-e554-4396-b684-17c7ba52094c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029337 Jul 12 13:25:31.778235 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 520/1045] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:25:31.786318 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3a9b79ad-73e5-44c3-90d6-ff8ecdcdb1ec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:25:31.879736 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3a9b79ad-73e5-44c3-90d6-ff8ecdcdb1ec tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "DELETE /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 204 len: 0 microversion: 2.1 time: 0.133481 Jul 12 13:25:31.883928 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 526/1046] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:25:31 2022] DELETE /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:25:31.889545 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-91382230-3c06-4869-bb54-0a490cb97d19 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:31.890247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-91382230-3c06-4869-bb54-0a490cb97d19 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:31.897407 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-91382230-3c06-4869-bb54-0a490cb97d19 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:31.897407 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-91382230-3c06-4869-bb54-0a490cb97d19 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:31.897934 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-91382230-3c06-4869-bb54-0a490cb97d19 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:31.898368 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-91382230-3c06-4869-bb54-0a490cb97d19 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:32.030280 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-91382230-3c06-4869-bb54-0a490cb97d19 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:32.038087 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-91382230-3c06-4869-bb54-0a490cb97d19 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1577 microversion: 2.1 time: 0.152833 Jul 12 13:25:32.038646 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 521/1047] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:31 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:25:33.057528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4892be72-3837-492a-a6ea-d1e795c5d796 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:33.058197 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-4892be72-3837-492a-a6ea-d1e795c5d796 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:33.065142 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4892be72-3837-492a-a6ea-d1e795c5d796 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:33.065583 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4892be72-3837-492a-a6ea-d1e795c5d796 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:33.066355 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4892be72-3837-492a-a6ea-d1e795c5d796 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:33.066765 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-4892be72-3837-492a-a6ea-d1e795c5d796 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:33.215434 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-4892be72-3837-492a-a6ea-d1e795c5d796 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:33.223656 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4892be72-3837-492a-a6ea-d1e795c5d796 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1577 microversion: 2.1 time: 0.171009 Jul 12 13:25:33.225270 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 527/1048] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:33 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:34.043271 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-f5c4eb6f-55d6-4fef-867c-d12f9623762f req-76461786-cd0c-47ca-88d6-766e5e25ea93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1", "name": "network-vif-deleted", "tag": "d470f6ed-02cc-4c43-a08c-b782931a9e5d"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:25:34.055179 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f5c4eb6f-55d6-4fef-867c-d12f9623762f req-76461786-cd0c-47ca-88d6-766e5e25ea93 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:34.055582 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-f5c4eb6f-55d6-4fef-867c-d12f9623762f req-76461786-cd0c-47ca-88d6-766e5e25ea93 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:34.068272 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-f5c4eb6f-55d6-4fef-867c-d12f9623762f req-76461786-cd0c-47ca-88d6-766e5e25ea93 service nova] Creating event network-vif-deleted:d470f6ed-02cc-4c43-a08c-b782931a9e5d for instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 on hv-cinder-79760 Jul 12 13:25:34.073488 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-f5c4eb6f-55d6-4fef-867c-d12f9623762f req-76461786-cd0c-47ca-88d6-766e5e25ea93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033917 Jul 12 13:25:34.074476 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 522/1049] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:25:34.247645 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-13dde18f-9fb3-40ae-a49c-a8126e2d3aab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:34.248249 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-13dde18f-9fb3-40ae-a49c-a8126e2d3aab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:34.255001 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-13dde18f-9fb3-40ae-a49c-a8126e2d3aab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:34.255389 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-13dde18f-9fb3-40ae-a49c-a8126e2d3aab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:34.256146 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-13dde18f-9fb3-40ae-a49c-a8126e2d3aab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:34.256571 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-13dde18f-9fb3-40ae-a49c-a8126e2d3aab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:34.324491 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-13dde18f-9fb3-40ae-a49c-a8126e2d3aab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:34.333377 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-13dde18f-9fb3-40ae-a49c-a8126e2d3aab tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 200 len: 1226 microversion: 2.1 time: 0.089956 Jul 12 13:25:34.334277 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 528/1050] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:34 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:35.353687 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:35.354494 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:35.361486 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:35.361900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:35.362688 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:35.363153 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:35.376494 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] HTTP exception thrown: Instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 could not be found. Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Request method failure captured: Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 HTTP/1.1 Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXR5NCdXXNYSzvnx9inA8_Kqvob1_StVXiy1nnhtTqqRgucZV6grzk2fdeRVQBh_hKD9aE-QGWR2T7f_LYwmCN8JF8v9h_KcJ_3Mo8P2ww7Pjh3byFEMjuDDXTu7tyA7q9cp2eb_xA81UkYaAfuY2RC5DA4HmC3mLEZR7YS5YXFeTrM Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:25:35.378103 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 0d6f70302739437b8d14fc0fd7967dac Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 could not be found. Jul 12 13:25:35.379838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1'} Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 could not be found. Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:25:35.380798 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 could not be found. Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 could not be found. Jul 12 13:25:35.382364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:35.383845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Returning 404 to user: Instance 25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:25:35.383845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-83a46ff9-3224-40c6-9954-df9ff2476385 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1" status: 404 len: 111 microversion: 2.1 time: 0.031530 Jul 12 13:25:35.383845 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 523/1051] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:35 2022] GET /compute/v2.1/servers/25ed8f36-7336-4a6f-a686-1e2dbdfeb4b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:25:38.526546 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-57f4d618-d589-444e-8654-7650efc6153e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:38.527085 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-57f4d618-d589-444e-8654-7650efc6153e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:38.528824 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-60bddc82-dca7-4fef-bb37-22c678b5e61b req-c378e0fd-12d1-4ae6-8e0f-454e6872db0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb9c528-38ad-4408-bb80-7dd426dbe142", "tag": "d140b555-5d1b-4434-853f-5cfc8f27c57e"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:25:38.534140 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-57f4d618-d589-444e-8654-7650efc6153e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:38.534591 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-57f4d618-d589-444e-8654-7650efc6153e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:38.535386 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-57f4d618-d589-444e-8654-7650efc6153e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:38.535817 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-57f4d618-d589-444e-8654-7650efc6153e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:38.538737 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-60bddc82-dca7-4fef-bb37-22c678b5e61b req-c378e0fd-12d1-4ae6-8e0f-454e6872db0d service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:38.539323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-60bddc82-dca7-4fef-bb37-22c678b5e61b req-c378e0fd-12d1-4ae6-8e0f-454e6872db0d service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:38.551192 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-60bddc82-dca7-4fef-bb37-22c678b5e61b req-c378e0fd-12d1-4ae6-8e0f-454e6872db0d service nova] Creating event network-changed:d140b555-5d1b-4434-853f-5cfc8f27c57e for instance bcb9c528-38ad-4408-bb80-7dd426dbe142 on hv-cinder-79760 Jul 12 13:25:38.556221 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-60bddc82-dca7-4fef-bb37-22c678b5e61b req-c378e0fd-12d1-4ae6-8e0f-454e6872db0d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031359 Jul 12 13:25:38.557214 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 524/1052] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:25:38.563025 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-57f4d618-d589-444e-8654-7650efc6153e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:25:38.652745 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-57f4d618-d589-444e-8654-7650efc6153e tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 204 len: 0 microversion: 2.1 time: 0.129639 Jul 12 13:25:38.653736 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 529/1053] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:25:38 2022] DELETE /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:25:38.664037 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b1521d89-ebe4-4c93-9198-b9febf5722e6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:38.664995 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b1521d89-ebe4-4c93-9198-b9febf5722e6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:38.672968 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1521d89-ebe4-4c93-9198-b9febf5722e6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:38.673465 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1521d89-ebe4-4c93-9198-b9febf5722e6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:38.674178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1521d89-ebe4-4c93-9198-b9febf5722e6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:38.674748 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b1521d89-ebe4-4c93-9198-b9febf5722e6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:38.818873 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-b1521d89-ebe4-4c93-9198-b9febf5722e6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:38.828036 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b1521d89-ebe4-4c93-9198-b9febf5722e6 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1578 microversion: 2.1 time: 0.168662 Jul 12 13:25:38.828640 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 525/1054] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:38 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:39.846186 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-6c4f82a4-f50b-40fe-b970-58410b175b46 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:39.846915 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-6c4f82a4-f50b-40fe-b970-58410b175b46 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:39.853671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6c4f82a4-f50b-40fe-b970-58410b175b46 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:39.854115 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6c4f82a4-f50b-40fe-b970-58410b175b46 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:39.854886 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6c4f82a4-f50b-40fe-b970-58410b175b46 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:39.855346 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-6c4f82a4-f50b-40fe-b970-58410b175b46 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:39.994233 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-6c4f82a4-f50b-40fe-b970-58410b175b46 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:40.006072 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-6c4f82a4-f50b-40fe-b970-58410b175b46 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1578 microversion: 2.1 time: 0.163901 Jul 12 13:25:40.006806 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 530/1055] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:39 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:40.941360 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-8b0164c5-5a5f-4020-9c42-cca9107134da req-58d93b70-32c4-458d-ac5d-9e7feec71774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb9c528-38ad-4408-bb80-7dd426dbe142", "name": "network-vif-deleted", "tag": "d140b555-5d1b-4434-853f-5cfc8f27c57e"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:25:40.949358 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8b0164c5-5a5f-4020-9c42-cca9107134da req-58d93b70-32c4-458d-ac5d-9e7feec71774 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:40.949797 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-8b0164c5-5a5f-4020-9c42-cca9107134da req-58d93b70-32c4-458d-ac5d-9e7feec71774 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:40.967728 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-8b0164c5-5a5f-4020-9c42-cca9107134da req-58d93b70-32c4-458d-ac5d-9e7feec71774 service nova] Creating event network-vif-deleted:d140b555-5d1b-4434-853f-5cfc8f27c57e for instance bcb9c528-38ad-4408-bb80-7dd426dbe142 on hv-cinder-79760 Jul 12 13:25:40.972682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-8b0164c5-5a5f-4020-9c42-cca9107134da req-58d93b70-32c4-458d-ac5d-9e7feec71774 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097783 Jul 12 13:25:40.973403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 526/1056] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:25:41.026359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-d7f5cd9e-ec76-4c2f-b3c7-02c77c520488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:41.027040 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-d7f5cd9e-ec76-4c2f-b3c7-02c77c520488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:41.034038 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd9e-ec76-4c2f-b3c7-02c77c520488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:41.034475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd9e-ec76-4c2f-b3c7-02c77c520488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:41.035252 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd9e-ec76-4c2f-b3c7-02c77c520488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:41.035677 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-d7f5cd9e-ec76-4c2f-b3c7-02c77c520488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:41.039754 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:41.099121 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-d7f5cd9e-ec76-4c2f-b3c7-02c77c520488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d6f70302739437b8d14fc0fd7967dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e603fb53b07e43a2b529f59a02f687fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:41.107357 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-d7f5cd9e-ec76-4c2f-b3c7-02c77c520488 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 200 len: 1226 microversion: 2.1 time: 0.084748 Jul 12 13:25:41.107921 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 531/1057] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:41 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:25:42.129956 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:42.131045 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: bcb9c528-38ad-4408-bb80-7dd426dbe142] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:42.140700 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:42.141143 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:42.141896 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:42.142324 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:42.156289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] HTTP exception thrown: Instance bcb9c528-38ad-4408-bb80-7dd426dbe142 could not be found. Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Request method failure captured: Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 HTTP/1.1 Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXR5NCdXXNYSzvnx9inA8_Kqvob1_StVXiy1nnhtTqqRgucZV6grzk2fdeRVQBh_hKD9aE-QGWR2T7f_LYwmCN8JF8v9h_KcJ_3Mo8P2ww7Pjh3byFEMjuDDXTu7tyA7q9cp2eb_xA81UkYaAfuY2RC5DA4HmC3mLEZR7YS5YXFeTrM Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:25:42.157903 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 0d6f70302739437b8d14fc0fd7967dac Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance bcb9c528-38ad-4408-bb80-7dd426dbe142 could not be found. Jul 12 13:25:42.159473 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': 'bcb9c528-38ad-4408-bb80-7dd426dbe142'} Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb9c528-38ad-4408-bb80-7dd426dbe142 could not be found. Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:25:42.160403 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb9c528-38ad-4408-bb80-7dd426dbe142 could not be found. Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb9c528-38ad-4408-bb80-7dd426dbe142 could not be found. Jul 12 13:25:42.162034 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.163874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Returning 404 to user: Instance bcb9c528-38ad-4408-bb80-7dd426dbe142 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:25:42.163874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-bbc29247-4208-4188-b4d7-434bce80ceb2 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142" status: 404 len: 111 microversion: 2.1 time: 0.037369 Jul 12 13:25:42.163874 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 527/1058] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:42 2022] GET /compute/v2.1/servers/bcb9c528-38ad-4408-bb80-7dd426dbe142 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:25:42.607860 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:42.608412 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:42.615085 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:42.615566 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:42.616302 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:42.616732 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:42.630642 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] HTTP exception thrown: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Request method failure captured: Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: DELETE /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 HTTP/1.1 Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXR5NCdXXNYSzvnx9inA8_Kqvob1_StVXiy1nnhtTqqRgucZV6grzk2fdeRVQBh_hKD9aE-QGWR2T7f_LYwmCN8JF8v9h_KcJ_3Mo8P2ww7Pjh3byFEMjuDDXTu7tyA7q9cp2eb_xA81UkYaAfuY2RC5DA4HmC3mLEZR7YS5YXFeTrM Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:25:42.632358 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 0d6f70302739437b8d14fc0fd7967dac Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.633978 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8'} Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:25:42.634916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.636497 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.638023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Returning 404 to user: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:25:42.638023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-65e0ae54-af65-444e-8162-a12ddea50223 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "DELETE /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 404 len: 111 microversion: 2.1 time: 0.030225 Jul 12 13:25:42.638023 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 532/1059] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:25:42 2022] DELETE /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:25:42.643003 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:42.643602 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] [instance: 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:42.649712 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:42.650178 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:42.650916 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:42.651372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:42.666878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] HTTP exception thrown: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Request method failure captured: Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 HTTP/1.1 Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXR5NCdXXNYSzvnx9inA8_Kqvob1_StVXiy1nnhtTqqRgucZV6grzk2fdeRVQBh_hKD9aE-QGWR2T7f_LYwmCN8JF8v9h_KcJ_3Mo8P2ww7Pjh3byFEMjuDDXTu7tyA7q9cp2eb_xA81UkYaAfuY2RC5DA4HmC3mLEZR7YS5YXFeTrM Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:25:42.668397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e603fb53b07e43a2b529f59a02f687fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: e603fb53b07e43a2b529f59a02f687fc Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-TestVolumeBootPattern-622949544 Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 0d6f70302739437b8d14fc0fd7967dac Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-TestVolumeBootPattern-622949544-project Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.670510 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8'} Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:25:42.671373 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. Jul 12 13:25:42.672628 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:25:42.673742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Returning 404 to user: Instance 341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:25:42.673742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-633390fe-7c95-4f50-befe-6f4458622ee5 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8" status: 404 len: 111 microversion: 2.1 time: 0.031163 Jul 12 13:25:42.673742 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 528/1060] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:42 2022] GET /compute/v2.1/servers/341ad7a7-3a1f-4ea3-b322-4adfab2b1cf8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:25:43.995287 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e68db908-50de-4557-aa0c-6f6d05751c15 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] Calling method '.version_select at 0x7fd48dc86dc0>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:44.019176 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e68db908-50de-4557-aa0c-6f6d05751c15 tempest-TestVolumeBootPattern-622949544 tempest-TestVolumeBootPattern-622949544-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1629722949" status: 202 len: 0 microversion: 2.1 time: 0.029493 Jul 12 13:25:44.020276 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 533/1061] 10.222.0.33 () {58 vars in 1262 bytes} [Tue Jul 12 13:25:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1629722949 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:25:59.511586 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-76f66791-87af-4202-bb67-08b08223ad24 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:59.512554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-76f66791-87af-4202-bb67-08b08223ad24 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:59.514886 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=34 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:59.515544 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:59.524079 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76f66791-87af-4202-bb67-08b08223ad24 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:59.524692 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76f66791-87af-4202-bb67-08b08223ad24 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:59.525827 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76f66791-87af-4202-bb67-08b08223ad24 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:59.526397 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-76f66791-87af-4202-bb67-08b08223ad24 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:59.558561 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-76f66791-87af-4202-bb67-08b08223ad24 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051201 Jul 12 13:25:59.559144 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 529/1062] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:25:59 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:25:59.615903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=6 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:59.616639 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:25:59.620839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c05dac38-9424-4d1a-af6e-7713014fdec9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:59.621353 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c05dac38-9424-4d1a-af6e-7713014fdec9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:59.629313 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c05dac38-9424-4d1a-af6e-7713014fdec9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:59.629758 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c05dac38-9424-4d1a-af6e-7713014fdec9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:59.630498 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c05dac38-9424-4d1a-af6e-7713014fdec9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:59.630920 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-c05dac38-9424-4d1a-af6e-7713014fdec9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:59.656393 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-c05dac38-9424-4d1a-af6e-7713014fdec9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Going to try to terminate instance {{(pid=117962) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:25:59.755794 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c05dac38-9424-4d1a-af6e-7713014fdec9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "DELETE /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 204 len: 0 microversion: 2.1 time: 0.140927 Jul 12 13:25:59.756386 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 534/1063] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:25:59 2022] DELETE /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:25:59.765272 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-eb67f0ee-74a4-4197-b402-783bc03f8d58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:25:59.765964 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-eb67f0ee-74a4-4197-b402-783bc03f8d58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:25:59.772136 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb67f0ee-74a4-4197-b402-783bc03f8d58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:59.772579 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb67f0ee-74a4-4197-b402-783bc03f8d58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:59.773336 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb67f0ee-74a4-4197-b402-783bc03f8d58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:25:59.773765 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-eb67f0ee-74a4-4197-b402-783bc03f8d58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:25:59.904937 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-eb67f0ee-74a4-4197-b402-783bc03f8d58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:25:59.912928 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-eb67f0ee-74a4-4197-b402-783bc03f8d58 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1669 microversion: 2.1 time: 0.151973 Jul 12 13:25:59.913719 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 530/1064] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:25:59 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:00.936653 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5bd5ede5-3d02-4faf-b864-589894255c3e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:00.937839 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-5bd5ede5-3d02-4faf-b864-589894255c3e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:00.948646 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5bd5ede5-3d02-4faf-b864-589894255c3e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:00.949381 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5bd5ede5-3d02-4faf-b864-589894255c3e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:00.951171 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5bd5ede5-3d02-4faf-b864-589894255c3e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:00.951700 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5bd5ede5-3d02-4faf-b864-589894255c3e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:01.111003 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-5bd5ede5-3d02-4faf-b864-589894255c3e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:01.122406 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5bd5ede5-3d02-4faf-b864-589894255c3e tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1669 microversion: 2.1 time: 0.193797 Jul 12 13:26:01.122990 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 535/1065] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:00 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1669 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:02.139106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-63758d2f-e59b-429e-9c59-85ea5c78f561 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:02.139712 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-63758d2f-e59b-429e-9c59-85ea5c78f561 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:02.146309 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-63758d2f-e59b-429e-9c59-85ea5c78f561 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:02.146691 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-63758d2f-e59b-429e-9c59-85ea5c78f561 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:02.147486 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-63758d2f-e59b-429e-9c59-85ea5c78f561 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:02.147915 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-63758d2f-e59b-429e-9c59-85ea5c78f561 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:02.288333 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-63758d2f-e59b-429e-9c59-85ea5c78f561 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:02.296278 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-63758d2f-e59b-429e-9c59-85ea5c78f561 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 200 len: 1669 microversion: 2.1 time: 0.161230 Jul 12 13:26:02.296857 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 531/1066] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:02 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:02.627241 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-743e5136-dd17-4ee3-9337-745ee1ed9948 req-632946bf-8775-43ab-8aea-10264ae04a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c8a8d8-c71e-4311-844b-2024fab89e92", "name": "network-vif-deleted", "tag": "0ab07ba0-ff81-426a-a8c2-bcb447d11b87"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:26:02.639419 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-743e5136-dd17-4ee3-9337-745ee1ed9948 req-632946bf-8775-43ab-8aea-10264ae04a82 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:02.639857 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-743e5136-dd17-4ee3-9337-745ee1ed9948 req-632946bf-8775-43ab-8aea-10264ae04a82 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:02.651716 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-743e5136-dd17-4ee3-9337-745ee1ed9948 req-632946bf-8775-43ab-8aea-10264ae04a82 service nova] Creating event network-vif-deleted:0ab07ba0-ff81-426a-a8c2-bcb447d11b87 for instance 47c8a8d8-c71e-4311-844b-2024fab89e92 on hv-cinder-79760 Jul 12 13:26:02.657017 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-743e5136-dd17-4ee3-9337-745ee1ed9948 req-632946bf-8775-43ab-8aea-10264ae04a82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040245 Jul 12 13:26:02.658122 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 536/1067] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:26:03.313336 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:03.313900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:03.320672 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:03.321124 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:03.321942 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:03.322377 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:03.336310 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] HTTP exception thrown: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Request method failure captured: Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 HTTP/1.1 Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXWaYW9JjGVYxJD-nyTrpC126INB3kNn54Jx5c2khaSUpFTgWuZahAGfQPn-NEgmMfKbJIFwYCGvGEA3ubgP-dZUA5UaT0czewkZ54pvae30xfgrhzkaR2M4HNbWBSuvEmnJrnMyRQAvLpx2k0IjtT1TEUvwQvPZBaPfSeG3tm1mBoo Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:26:03.337592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 648010798a7441fc9af3c682db2bfdc7 Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:26:03.339453 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '47c8a8d8-c71e-4311-844b-2024fab89e92'} Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:26:03.340471 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:26:03.342219 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:26:03.344222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Returning 404 to user: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:26:03.344222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3d9e80d2-64e9-4562-9497-8cf5cd1ef418 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 404 len: 111 microversion: 2.1 time: 0.029765 Jul 12 13:26:03.344222 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 532/1068] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:03 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:26:03.348976 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c99e4c7d-5d1d-47cc-9e5c-4970eb53edc9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '.version_select at 0x7fd48d1058b0>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:03.368655 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c99e4c7d-5d1d-47cc-9e5c-4970eb53edc9 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-965820670" status: 202 len: 0 microversion: 2.1 time: 0.024060 Jul 12 13:26:03.369273 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 537/1069] 10.222.0.33 () {58 vars in 1217 bytes} [Tue Jul 12 13:26:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-965820670 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:26:04.018611 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b6fd63f3-9974-408a-a215-3ede61c81fe5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'create', calling method: .version_select at 0x7fd48d1b54c0>, body: {"keypair": {"name": "tempest-keypair-1758480412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhKS7PbYAae4aaDPEYdY/aAvj2LgZpFe+mpT2Vd72CgISEiZnziD1W8H8sEHE4oBzSrehFLXuep5fz17O/154vokrzEyy2tOz6VY+cbk+0dRQ+h6uCkt6+F2hXWZqhFMQ=="}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:26:04.033908 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-b6fd63f3-9974-408a-a215-3ede61c81fe5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Getting quotas for project ea5e3f6292234dacb166b604e41b40e3. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:26:04.038307 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.quota [None req-b6fd63f3-9974-408a-a215-3ede61c81fe5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Getting quotas for user 648010798a7441fc9af3c682db2bfdc7 and project ea5e3f6292234dacb166b604e41b40e3. Resources: {'key_pairs'} {{(pid=117963) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:26:04.065920 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b6fd63f3-9974-408a-a215-3ede61c81fe5 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051205 Jul 12 13:26:04.066503 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 533/1070] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Jul 12 13:26:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:26:05.380224 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-940216091", "imageRef": "3bc66cfb-68e6-4006-a2b0-75da9af4eb15", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1f27e34-3fdd-4c69-89b3-ea2a10c194a5"}], "security_groups": [{"name": "tempest-securitygroup--1437777983"}], "key_name": "tempest-keypair-1758480412", "user_data": "}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:26:05.488500 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.network.neutron [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] validate_networks() for [('f1f27e34-3fdd-4c69-89b3-ea2a10c194a5', None, None, None, None, None)] {{(pid=117962) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:26:05.982290 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Flavor limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:26:05.982712 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Image limits 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:26:05.983214 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Flavor pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:26:05.983630 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Image pref 0:0:0 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:26:05.984043 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.virt.hardware [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117962) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:26:05.993649 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:05.994103 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:05.994896 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:05.995365 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:06.012460 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Getting quotas for project ea5e3f6292234dacb166b604e41b40e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:26:06.016375 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.quota [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Getting quotas for user 648010798a7441fc9af3c682db2bfdc7 and project ea5e3f6292234dacb166b604e41b40e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117962) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:26:06.027589 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Going to run 1 instances... {{(pid=117962) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:26:06.029979 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bc66cfb-68e6-4006-a2b0-75da9af4eb15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117962) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:26:06.079777 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-376ef43f-bc30-40cd-b400-d715899bc091 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.703822 Jul 12 13:26:06.080447 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 538/1071] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Jul 12 13:26:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:26:06.091230 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5ca16e5d-4487-4b42-8d75-5168ea475a00 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:06.091812 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-5ca16e5d-4487-4b42-8d75-5168ea475a00 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:06.150158 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-5ca16e5d-4487-4b42-8d75-5168ea475a00 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:06.156981 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5ca16e5d-4487-4b42-8d75-5168ea475a00 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1237 microversion: 2.1 time: 0.070324 Jul 12 13:26:06.166083 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 534/1072] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:06 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:26:07.174892 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fdb6e077-bdc8-4a15-95c7-0488a8e3ac44 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:07.175738 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-fdb6e077-bdc8-4a15-95c7-0488a8e3ac44 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:07.182313 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fdb6e077-bdc8-4a15-95c7-0488a8e3ac44 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:07.182733 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fdb6e077-bdc8-4a15-95c7-0488a8e3ac44 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:07.183530 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fdb6e077-bdc8-4a15-95c7-0488a8e3ac44 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:07.183952 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-fdb6e077-bdc8-4a15-95c7-0488a8e3ac44 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:07.264805 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-fdb6e077-bdc8-4a15-95c7-0488a8e3ac44 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:07.272484 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fdb6e077-bdc8-4a15-95c7-0488a8e3ac44 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1297 microversion: 2.1 time: 0.102417 Jul 12 13:26:07.273055 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 539/1073] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:07 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:08.289938 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d40e1ff4-78d7-443f-8b94-dec3db539aac tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:08.290689 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d40e1ff4-78d7-443f-8b94-dec3db539aac tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:08.298428 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d40e1ff4-78d7-443f-8b94-dec3db539aac tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:08.298917 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d40e1ff4-78d7-443f-8b94-dec3db539aac tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:08.299836 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d40e1ff4-78d7-443f-8b94-dec3db539aac tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:08.300361 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d40e1ff4-78d7-443f-8b94-dec3db539aac tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:08.450371 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-d40e1ff4-78d7-443f-8b94-dec3db539aac tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:08.462694 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d40e1ff4-78d7-443f-8b94-dec3db539aac tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1363 microversion: 2.1 time: 0.176758 Jul 12 13:26:08.463576 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 535/1074] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:08 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:08.927793 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-62ebb638-f7f7-4c5c-b709-2ccde83d123a req-5482a29e-f158-44d6-b61f-24009f657ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5236486f-e41e-4a5e-99f3-7cc9a6171a09", "tag": "a4fa16cc-ee29-4b9a-957a-1b87fb4e9908"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:26:08.937082 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-62ebb638-f7f7-4c5c-b709-2ccde83d123a req-5482a29e-f158-44d6-b61f-24009f657ba8 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:08.937509 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-62ebb638-f7f7-4c5c-b709-2ccde83d123a req-5482a29e-f158-44d6-b61f-24009f657ba8 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:08.952715 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-62ebb638-f7f7-4c5c-b709-2ccde83d123a req-5482a29e-f158-44d6-b61f-24009f657ba8 service nova] Creating event network-changed:a4fa16cc-ee29-4b9a-957a-1b87fb4e9908 for instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 on hv-cinder-79760 Jul 12 13:26:08.958726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-62ebb638-f7f7-4c5c-b709-2ccde83d123a req-5482a29e-f158-44d6-b61f-24009f657ba8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034785 Jul 12 13:26:08.959359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 540/1075] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:26:09.482346 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-281e29cf-99e6-4fbf-9484-751638ad00e0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:09.483052 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-281e29cf-99e6-4fbf-9484-751638ad00e0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:09.491247 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281e29cf-99e6-4fbf-9484-751638ad00e0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:09.491835 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281e29cf-99e6-4fbf-9484-751638ad00e0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:09.492754 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281e29cf-99e6-4fbf-9484-751638ad00e0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:09.493279 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-281e29cf-99e6-4fbf-9484-751638ad00e0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:09.649090 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-281e29cf-99e6-4fbf-9484-751638ad00e0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:09.657016 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-281e29cf-99e6-4fbf-9484-751638ad00e0 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1363 microversion: 2.1 time: 0.180312 Jul 12 13:26:09.657592 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 536/1076] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:09 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:10.676036 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a325b3d5-4923-4376-a28d-65ded2864658 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:10.677437 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a325b3d5-4923-4376-a28d-65ded2864658 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:10.684921 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a325b3d5-4923-4376-a28d-65ded2864658 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:10.685148 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a325b3d5-4923-4376-a28d-65ded2864658 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:10.685923 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a325b3d5-4923-4376-a28d-65ded2864658 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:10.686367 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a325b3d5-4923-4376-a28d-65ded2864658 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:10.828957 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-a325b3d5-4923-4376-a28d-65ded2864658 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:10.836749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a325b3d5-4923-4376-a28d-65ded2864658 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1363 microversion: 2.1 time: 0.164955 Jul 12 13:26:10.837324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 541/1077] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:10 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:26:11.856781 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-24e09c28-7ea0-4135-a245-1669cdca2b30 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:11.857504 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-24e09c28-7ea0-4135-a245-1669cdca2b30 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:11.867260 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24e09c28-7ea0-4135-a245-1669cdca2b30 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:11.868052 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24e09c28-7ea0-4135-a245-1669cdca2b30 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:11.869210 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24e09c28-7ea0-4135-a245-1669cdca2b30 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:11.869723 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-24e09c28-7ea0-4135-a245-1669cdca2b30 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:12.016411 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-24e09c28-7ea0-4135-a245-1669cdca2b30 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:12.024248 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-24e09c28-7ea0-4135-a245-1669cdca2b30 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1363 microversion: 2.1 time: 0.173946 Jul 12 13:26:12.024817 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 537/1078] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:11 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:13.042136 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-62cecd08-f4f4-4a1d-aaf6-e264b4a49243 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:13.042801 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-62cecd08-f4f4-4a1d-aaf6-e264b4a49243 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:13.050107 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62cecd08-f4f4-4a1d-aaf6-e264b4a49243 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:13.050624 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62cecd08-f4f4-4a1d-aaf6-e264b4a49243 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:13.051473 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62cecd08-f4f4-4a1d-aaf6-e264b4a49243 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:13.052007 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-62cecd08-f4f4-4a1d-aaf6-e264b4a49243 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:13.193527 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-62cecd08-f4f4-4a1d-aaf6-e264b4a49243 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:13.205562 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-62cecd08-f4f4-4a1d-aaf6-e264b4a49243 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1363 microversion: 2.1 time: 0.167110 Jul 12 13:26:13.206384 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 542/1079] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:13 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:14.224026 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-70c18202-4fe6-4d1a-85b8-293b0a5be00b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:14.224602 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-70c18202-4fe6-4d1a-85b8-293b0a5be00b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:14.232548 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-70c18202-4fe6-4d1a-85b8-293b0a5be00b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:14.232958 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-70c18202-4fe6-4d1a-85b8-293b0a5be00b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:14.233818 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-70c18202-4fe6-4d1a-85b8-293b0a5be00b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:14.234248 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-70c18202-4fe6-4d1a-85b8-293b0a5be00b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:14.379773 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-70c18202-4fe6-4d1a-85b8-293b0a5be00b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:14.387717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-70c18202-4fe6-4d1a-85b8-293b0a5be00b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1363 microversion: 2.1 time: 0.167526 Jul 12 13:26:14.388297 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 538/1080] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:14 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:14.787475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-9c3f7f6b-9fff-4acf-a53d-e1fc49223313 req-79f7aa81-6e1f-44d3-a382-b08fc3965b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5236486f-e41e-4a5e-99f3-7cc9a6171a09", "name": "network-vif-plugged", "status": "completed", "tag": "a4fa16cc-ee29-4b9a-957a-1b87fb4e9908"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:26:14.796368 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-9c3f7f6b-9fff-4acf-a53d-e1fc49223313 req-79f7aa81-6e1f-44d3-a382-b08fc3965b94 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:14.796844 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-9c3f7f6b-9fff-4acf-a53d-e1fc49223313 req-79f7aa81-6e1f-44d3-a382-b08fc3965b94 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:14.810416 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-9c3f7f6b-9fff-4acf-a53d-e1fc49223313 req-79f7aa81-6e1f-44d3-a382-b08fc3965b94 service nova] Creating event network-vif-plugged:a4fa16cc-ee29-4b9a-957a-1b87fb4e9908 for instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 on hv-cinder-79760 Jul 12 13:26:14.815482 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-9c3f7f6b-9fff-4acf-a53d-e1fc49223313 req-79f7aa81-6e1f-44d3-a382-b08fc3965b94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153198 Jul 12 13:26:14.816066 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 543/1081] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:26:15.408938 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-9a3cd412-a59b-48ac-b84d-31dc6fa1fc2b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:15.409950 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-9a3cd412-a59b-48ac-b84d-31dc6fa1fc2b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:15.421338 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a3cd412-a59b-48ac-b84d-31dc6fa1fc2b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:15.422073 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a3cd412-a59b-48ac-b84d-31dc6fa1fc2b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:15.423430 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a3cd412-a59b-48ac-b84d-31dc6fa1fc2b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:15.424141 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-9a3cd412-a59b-48ac-b84d-31dc6fa1fc2b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:15.561364 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-9a3cd412-a59b-48ac-b84d-31dc6fa1fc2b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:15.574870 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-9a3cd412-a59b-48ac-b84d-31dc6fa1fc2b tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1363 microversion: 2.1 time: 0.172364 Jul 12 13:26:15.576093 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 539/1082] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:15 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:16.590562 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=2 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:16.591352 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell0:SELECT=6 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:16.595710 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0e88f3c3-aa0b-405a-9bec-11b25061a5d6 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:16.596412 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0e88f3c3-aa0b-405a-9bec-11b25061a5d6 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:16.603473 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e88f3c3-aa0b-405a-9bec-11b25061a5d6 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:16.603918 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e88f3c3-aa0b-405a-9bec-11b25061a5d6 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:16.604671 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e88f3c3-aa0b-405a-9bec-11b25061a5d6 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:16.605105 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0e88f3c3-aa0b-405a-9bec-11b25061a5d6 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:16.737392 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-0e88f3c3-aa0b-405a-9bec-11b25061a5d6 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:26:16.745258 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0e88f3c3-aa0b-405a-9bec-11b25061a5d6 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1547 microversion: 2.1 time: 0.156111 Jul 12 13:26:16.745857 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 544/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:26:16 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:26:16.761587 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b46ced00-1cea-4bc4-aef4-c46b2b433288 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:16.762105 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-b46ced00-1cea-4bc4-aef4-c46b2b433288 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:16.763888 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell0:SELECT=6 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:16.769902 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b46ced00-1cea-4bc4-aef4-c46b2b433288 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:16.770340 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b46ced00-1cea-4bc4-aef4-c46b2b433288 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:16.771124 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b46ced00-1cea-4bc4-aef4-c46b2b433288 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:16.771553 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-b46ced00-1cea-4bc4-aef4-c46b2b433288 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:16.848951 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b46ced00-1cea-4bc4-aef4-c46b2b433288 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090946 Jul 12 13:26:16.849823 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 540/1084] 10.222.0.33 () {58 vars in 1274 bytes} [Tue Jul 12 13:26:16 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:26:18.089061 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [req-113751fc-1ed8-4d93-8421-ad5992e04729 req-613cd07a-6a4c-4b9a-838f-6224ad8ca46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5236486f-e41e-4a5e-99f3-7cc9a6171a09", "tag": "a4fa16cc-ee29-4b9a-957a-1b87fb4e9908"}]} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:26:18.097655 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-113751fc-1ed8-4d93-8421-ad5992e04729 req-613cd07a-6a4c-4b9a-838f-6224ad8ca46c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:18.098096 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [req-113751fc-1ed8-4d93-8421-ad5992e04729 req-613cd07a-6a4c-4b9a-838f-6224ad8ca46c service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:18.109598 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.compute.server_external_events [req-113751fc-1ed8-4d93-8421-ad5992e04729 req-613cd07a-6a4c-4b9a-838f-6224ad8ca46c service nova] Creating event network-changed:a4fa16cc-ee29-4b9a-957a-1b87fb4e9908 for instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 on hv-cinder-79760 Jul 12 13:26:18.114509 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [req-113751fc-1ed8-4d93-8421-ad5992e04729 req-613cd07a-6a4c-4b9a-838f-6224ad8ca46c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084751 Jul 12 13:26:18.115171 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 545/1085] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:26:47.547975 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:47.548767 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=54 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:47.552973 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-d61cd414-1d70-4c4f-917c-9518ea7ce17f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:47.553502 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-d61cd414-1d70-4c4f-917c-9518ea7ce17f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:47.561807 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d61cd414-1d70-4c4f-917c-9518ea7ce17f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:47.562289 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d61cd414-1d70-4c4f-917c-9518ea7ce17f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:47.563150 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d61cd414-1d70-4c4f-917c-9518ea7ce17f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:47.563622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-d61cd414-1d70-4c4f-917c-9518ea7ce17f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:47.588106 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-d61cd414-1d70-4c4f-917c-9518ea7ce17f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/ips" status: 200 len: 144 microversion: 2.1 time: 0.043140 Jul 12 13:26:47.588661 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 541/1086] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:26:47 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:26:48.923151 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:48.923997 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:48.930610 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3af3e365-5e87-4969-92fd-e4d194f1d049 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c669b95-2c12-48af-8854-d7777c7f86a7"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:26:48.932433 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3af3e365-5e87-4969-92fd-e4d194f1d049 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:48.942325 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3af3e365-5e87-4969-92fd-e4d194f1d049 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:48.942766 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3af3e365-5e87-4969-92fd-e4d194f1d049 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:48.943550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3af3e365-5e87-4969-92fd-e4d194f1d049 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:48.943983 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3af3e365-5e87-4969-92fd-e4d194f1d049 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:49.221874 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3af3e365-5e87-4969-92fd-e4d194f1d049 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301628 Jul 12 13:26:49.223301 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 546/1087] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:26:48 2022] POST /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:26:56.778249 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-88a81342-3467-4604-9d3f-c0e1b927d9fd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:56.779210 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-88a81342-3467-4604-9d3f-c0e1b927d9fd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:56.786763 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88a81342-3467-4604-9d3f-c0e1b927d9fd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:56.787304 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88a81342-3467-4604-9d3f-c0e1b927d9fd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:56.788151 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88a81342-3467-4604-9d3f-c0e1b927d9fd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:56.788571 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-88a81342-3467-4604-9d3f-c0e1b927d9fd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:56.818290 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-88a81342-3467-4604-9d3f-c0e1b927d9fd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Jul 12 13:26:56.818851 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 542/1088] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:26:56 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:26:56.829541 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-5d0a7573-e1b6-41b2-8336-7cf7117cf234 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:26:56.830201 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-5d0a7573-e1b6-41b2-8336-7cf7117cf234 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:56.837130 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5d0a7573-e1b6-41b2-8336-7cf7117cf234 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:56.837579 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5d0a7573-e1b6-41b2-8336-7cf7117cf234 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:56.838345 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5d0a7573-e1b6-41b2-8336-7cf7117cf234 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:56.838776 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-5d0a7573-e1b6-41b2-8336-7cf7117cf234 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:56.869268 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-5d0a7573-e1b6-41b2-8336-7cf7117cf234 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/7c669b95-2c12-48af-8854-d7777c7f86a7" status: 200 len: 194 microversion: 2.1 time: 0.044243 Jul 12 13:26:56.869852 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 547/1089] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Jul 12 13:26:56 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/7c669b95-2c12-48af-8854-d7777c7f86a7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:26:58.206947 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-818645ce-1f03-4d34-82b0-e2ce730b9b36 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9c3cabe-fbcf-4ae6-b4d2-7fcb51028fd3"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:26:58.208069 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-818645ce-1f03-4d34-82b0-e2ce730b9b36 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:26:58.215126 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-818645ce-1f03-4d34-82b0-e2ce730b9b36 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:58.215567 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-818645ce-1f03-4d34-82b0-e2ce730b9b36 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:58.216356 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-818645ce-1f03-4d34-82b0-e2ce730b9b36 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:26:58.216788 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-818645ce-1f03-4d34-82b0-e2ce730b9b36 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:26:58.489274 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-818645ce-1f03-4d34-82b0-e2ce730b9b36 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "POST /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286274 Jul 12 13:26:58.489886 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 543/1090] 10.222.0.33 () {60 vars in 1322 bytes} [Tue Jul 12 13:26:58 2022] POST /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:06.043550 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-42efb216-511d-4854-b639-019c1a1f6aeb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:06.044532 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-42efb216-511d-4854-b639-019c1a1f6aeb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:06.051601 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42efb216-511d-4854-b639-019c1a1f6aeb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:06.052043 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42efb216-511d-4854-b639-019c1a1f6aeb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:06.052788 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42efb216-511d-4854-b639-019c1a1f6aeb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:06.053213 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-42efb216-511d-4854-b639-019c1a1f6aeb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:06.082330 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-42efb216-511d-4854-b639-019c1a1f6aeb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042755 Jul 12 13:27:06.082863 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 548/1091] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:27:06 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:06.231123 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-dbddc136-282d-4d84-95a6-2fbb8817a87f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:06.231792 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-dbddc136-282d-4d84-95a6-2fbb8817a87f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:06.239695 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbddc136-282d-4d84-95a6-2fbb8817a87f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:06.240110 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbddc136-282d-4d84-95a6-2fbb8817a87f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:06.240878 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbddc136-282d-4d84-95a6-2fbb8817a87f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:06.241304 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-dbddc136-282d-4d84-95a6-2fbb8817a87f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:06.270646 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-dbddc136-282d-4d84-95a6-2fbb8817a87f tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/7c669b95-2c12-48af-8854-d7777c7f86a7" status: 200 len: 194 microversion: 2.1 time: 0.044418 Jul 12 13:27:06.271269 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 544/1092] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Jul 12 13:27:06 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/7c669b95-2c12-48af-8854-d7777c7f86a7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:06.284237 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-e9e32d81-b982-4ad6-b0e7-055fb37b83bd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:06.285037 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-e9e32d81-b982-4ad6-b0e7-055fb37b83bd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:06.295232 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e9e32d81-b982-4ad6-b0e7-055fb37b83bd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:06.296292 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e9e32d81-b982-4ad6-b0e7-055fb37b83bd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:06.297498 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e9e32d81-b982-4ad6-b0e7-055fb37b83bd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:06.297983 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-e9e32d81-b982-4ad6-b0e7-055fb37b83bd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:06.383717 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-e9e32d81-b982-4ad6-b0e7-055fb37b83bd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lazy-loading 'services' on Instance uuid 5236486f-e41e-4a5e-99f3-7cc9a6171a09 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:27:06.461654 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-e9e32d81-b982-4ad6-b0e7-055fb37b83bd tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/7c669b95-2c12-48af-8854-d7777c7f86a7" status: 202 len: 0 microversion: 2.1 time: 0.184000 Jul 12 13:27:06.462245 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 549/1093] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:27:06 2022] DELETE /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/7c669b95-2c12-48af-8854-d7777c7f86a7 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:27:07.581863 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-66843c48-9971-4f19-9cc7-c39d6e6d3630 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:07.582521 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-66843c48-9971-4f19-9cc7-c39d6e6d3630 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:07.589041 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66843c48-9971-4f19-9cc7-c39d6e6d3630 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:07.589486 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66843c48-9971-4f19-9cc7-c39d6e6d3630 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:07.590249 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66843c48-9971-4f19-9cc7-c39d6e6d3630 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:07.590678 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-66843c48-9971-4f19-9cc7-c39d6e6d3630 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:07.619057 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-66843c48-9971-4f19-9cc7-c39d6e6d3630 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/d9c3cabe-fbcf-4ae6-b4d2-7fcb51028fd3" status: 200 len: 194 microversion: 2.1 time: 0.047143 Jul 12 13:27:07.619646 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 545/1094] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Jul 12 13:27:07 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/d9c3cabe-fbcf-4ae6-b4d2-7fcb51028fd3 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:07.630761 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a533b4b0-53f4-4e7c-b31a-398e1c393c62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:07.631324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-a533b4b0-53f4-4e7c-b31a-398e1c393c62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:07.637846 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a533b4b0-53f4-4e7c-b31a-398e1c393c62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:07.638296 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a533b4b0-53f4-4e7c-b31a-398e1c393c62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:07.639095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a533b4b0-53f4-4e7c-b31a-398e1c393c62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:07.639527 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-a533b4b0-53f4-4e7c-b31a-398e1c393c62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:07.735672 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.objects.instance [None req-a533b4b0-53f4-4e7c-b31a-398e1c393c62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lazy-loading 'services' on Instance uuid 5236486f-e41e-4a5e-99f3-7cc9a6171a09 {{(pid=117962) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:27:07.814909 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a533b4b0-53f4-4e7c-b31a-398e1c393c62 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/d9c3cabe-fbcf-4ae6-b4d2-7fcb51028fd3" status: 202 len: 0 microversion: 2.1 time: 0.188556 Jul 12 13:27:07.815743 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 550/1095] 10.222.0.33 () {58 vars in 1415 bytes} [Tue Jul 12 13:27:07 2022] DELETE /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments/d9c3cabe-fbcf-4ae6-b4d2-7fcb51028fd3 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:27:08.985226 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c3b4b78c-0575-4dfc-a1d6-4d36897aeca8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:08.986218 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-c3b4b78c-0575-4dfc-a1d6-4d36897aeca8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:08.992976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3b4b78c-0575-4dfc-a1d6-4d36897aeca8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:08.993418 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3b4b78c-0575-4dfc-a1d6-4d36897aeca8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:08.994136 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3b4b78c-0575-4dfc-a1d6-4d36897aeca8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:08.994593 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-c3b4b78c-0575-4dfc-a1d6-4d36897aeca8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:09.026094 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c3b4b78c-0575-4dfc-a1d6-4d36897aeca8 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045297 Jul 12 13:27:09.026646 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 546/1096] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:27:08 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:27:09.139726 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-3f6afd97-474c-4951-8261-a744a15e50d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:09.140779 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-3f6afd97-474c-4951-8261-a744a15e50d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:09.147332 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3f6afd97-474c-4951-8261-a744a15e50d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:09.147770 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3f6afd97-474c-4951-8261-a744a15e50d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:09.148525 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3f6afd97-474c-4951-8261-a744a15e50d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:09.148955 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-3f6afd97-474c-4951-8261-a744a15e50d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:09.177338 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-3f6afd97-474c-4951-8261-a744a15e50d7 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042605 Jul 12 13:27:09.177890 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 551/1097] 10.222.0.33 () {58 vars in 1301 bytes} [Tue Jul 12 13:27:09 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:27:09.235927 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-29c94aa9-1f47-4d78-89b6-c38f196302cb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:09.236419 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-29c94aa9-1f47-4d78-89b6-c38f196302cb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:09.242915 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29c94aa9-1f47-4d78-89b6-c38f196302cb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:09.243389 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29c94aa9-1f47-4d78-89b6-c38f196302cb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:09.244135 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29c94aa9-1f47-4d78-89b6-c38f196302cb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:09.244552 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-29c94aa9-1f47-4d78-89b6-c38f196302cb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:09.268883 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-29c94aa9-1f47-4d78-89b6-c38f196302cb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Going to try to terminate instance {{(pid=117963) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:27:09.350770 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-29c94aa9-1f47-4d78-89b6-c38f196302cb tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 204 len: 0 microversion: 2.1 time: 0.118456 Jul 12 13:27:09.351815 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 547/1098] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:27:09 2022] DELETE /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:09.360397 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-786a3444-4e4d-4b08-b1bb-0dfa24eb97b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:09.361013 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-786a3444-4e4d-4b08-b1bb-0dfa24eb97b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:09.367320 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-786a3444-4e4d-4b08-b1bb-0dfa24eb97b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:09.367705 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-786a3444-4e4d-4b08-b1bb-0dfa24eb97b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:09.368454 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-786a3444-4e4d-4b08-b1bb-0dfa24eb97b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:09.368882 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-786a3444-4e4d-4b08-b1bb-0dfa24eb97b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:09.502980 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-786a3444-4e4d-4b08-b1bb-0dfa24eb97b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:09.510988 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-786a3444-4e4d-4b08-b1bb-0dfa24eb97b1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1672 microversion: 2.1 time: 0.155052 Jul 12 13:27:09.511565 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 552/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:09 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:10.533371 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-cfd88cf9-92b0-4d7a-a65e-a7ef5fa0aa26 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:10.534098 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-cfd88cf9-92b0-4d7a-a65e-a7ef5fa0aa26 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:10.542478 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfd88cf9-92b0-4d7a-a65e-a7ef5fa0aa26 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:10.543081 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfd88cf9-92b0-4d7a-a65e-a7ef5fa0aa26 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:10.544025 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfd88cf9-92b0-4d7a-a65e-a7ef5fa0aa26 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:10.544558 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-cfd88cf9-92b0-4d7a-a65e-a7ef5fa0aa26 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:10.683996 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.policy [None req-cfd88cf9-92b0-4d7a-a65e-a7ef5fa0aa26 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117963) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:10.692717 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-cfd88cf9-92b0-4d7a-a65e-a7ef5fa0aa26 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1672 microversion: 2.1 time: 0.166302 Jul 12 13:27:10.693288 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 548/1100] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:10 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:11.710004 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1ef56a6d-5939-4e81-9a3a-b48e10965eee tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:11.710903 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-1ef56a6d-5939-4e81-9a3a-b48e10965eee tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:11.717572 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ef56a6d-5939-4e81-9a3a-b48e10965eee tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:11.718016 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ef56a6d-5939-4e81-9a3a-b48e10965eee tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:11.718775 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ef56a6d-5939-4e81-9a3a-b48e10965eee tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:11.719279 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1ef56a6d-5939-4e81-9a3a-b48e10965eee tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:11.790576 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.policy [None req-1ef56a6d-5939-4e81-9a3a-b48e10965eee tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648010798a7441fc9af3c682db2bfdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5e3f6292234dacb166b604e41b40e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117962) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:27:11.798704 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-1ef56a6d-5939-4e81-9a3a-b48e10965eee tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 200 len: 1604 microversion: 2.1 time: 0.092728 Jul 12 13:27:11.799319 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 553/1101] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:11 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 1604 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:12.005406 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [req-2fbcd14a-b3d3-4cc5-9f70-becda72d0c0f req-91da70f2-e6c1-4899-8d36-4f18c78cb1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5236486f-e41e-4a5e-99f3-7cc9a6171a09", "name": "network-vif-deleted", "tag": "a4fa16cc-ee29-4b9a-957a-1b87fb4e9908"}]} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:12.014174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-2fbcd14a-b3d3-4cc5-9f70-becda72d0c0f req-91da70f2-e6c1-4899-8d36-4f18c78cb1a9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:12.014695 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [req-2fbcd14a-b3d3-4cc5-9f70-becda72d0c0f req-91da70f2-e6c1-4899-8d36-4f18c78cb1a9 service nova] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:12.026252 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.compute.server_external_events [req-2fbcd14a-b3d3-4cc5-9f70-becda72d0c0f req-91da70f2-e6c1-4899-8d36-4f18c78cb1a9 service nova] Creating event network-vif-deleted:a4fa16cc-ee29-4b9a-957a-1b87fb4e9908 for instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 on hv-cinder-79760 Jul 12 13:27:12.031228 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [req-2fbcd14a-b3d3-4cc5-9f70-becda72d0c0f req-91da70f2-e6c1-4899-8d36-4f18c78cb1a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029531 Jul 12 13:27:12.032347 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 549/1102] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Jul 12 13:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:12.816732 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:12.817445 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:12.824240 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:12.824780 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:12.825590 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:12.826022 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:12.843052 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] HTTP exception thrown: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Request method failure captured: Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 HTTP/1.1 Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXWaYW9JjGVYxJD-nyTrpC126INB3kNn54Jx5c2khaSUpFTgWuZahAGfQPn-NEgmMfKbJIFwYCGvGEA3ubgP-dZUA5UaT0czewkZ54pvae30xfgrhzkaR2M4HNbWBSuvEmnJrnMyRQAvLpx2k0IjtT1TEUvwQvPZBaPfSeG3tm1mBoo Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:27:12.844791 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 648010798a7441fc9af3c682db2bfdc7 Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:12.846427 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '5236486f-e41e-4a5e-99f3-7cc9a6171a09'} Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:12.847489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:12.849059 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:12.850749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Returning 404 to user: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:12.850749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0b6d1057-d2fa-439c-9ca7-dba4f4eec838 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 404 len: 111 microversion: 2.1 time: 0.033975 Jul 12 13:27:12.850749 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 554/1103] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:12 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:12.856005 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-3689931a-e06e-4138-8819-018cd29fee25 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '.version_select at 0x7fd48d142940>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:12.876304 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-3689931a-e06e-4138-8819-018cd29fee25 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758480412" status: 202 len: 0 microversion: 2.1 time: 0.024494 Jul 12 13:27:12.876900 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 550/1104] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Jul 12 13:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758480412 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:27:15.802387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:15.802900 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:15.809755 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:15.810199 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:15.810980 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:15.811420 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:15.825853 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] HTTP exception thrown: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Request method failure captured: Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: DELETE /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 HTTP/1.1 Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXWaYW9JjGVYxJD-nyTrpC126INB3kNn54Jx5c2khaSUpFTgWuZahAGfQPn-NEgmMfKbJIFwYCGvGEA3ubgP-dZUA5UaT0czewkZ54pvae30xfgrhzkaR2M4HNbWBSuvEmnJrnMyRQAvLpx2k0IjtT1TEUvwQvPZBaPfSeG3tm1mBoo Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:27:15.827418 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 648010798a7441fc9af3c682db2bfdc7 Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.829162 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '5236486f-e41e-4a5e-99f3-7cc9a6171a09'} Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:15.830093 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.831628 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.833147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Returning 404 to user: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:15.833147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cd7af8fe-d20d-4b08-8e36-f8cb5cd4a2fa tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 404 len: 111 microversion: 2.1 time: 0.030323 Jul 12 13:27:15.833147 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 555/1105] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:27:15 2022] DELETE /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:15.837802 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:15.838625 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 5236486f-e41e-4a5e-99f3-7cc9a6171a09] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:15.845988 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:15.846425 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:15.847210 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:15.847636 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:15.860963 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] HTTP exception thrown: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Request method failure captured: Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 HTTP/1.1 Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXWaYW9JjGVYxJD-nyTrpC126INB3kNn54Jx5c2khaSUpFTgWuZahAGfQPn-NEgmMfKbJIFwYCGvGEA3ubgP-dZUA5UaT0czewkZ54pvae30xfgrhzkaR2M4HNbWBSuvEmnJrnMyRQAvLpx2k0IjtT1TEUvwQvPZBaPfSeG3tm1mBoo Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:27:15.862554 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 648010798a7441fc9af3c682db2bfdc7 Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.864145 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '5236486f-e41e-4a5e-99f3-7cc9a6171a09'} Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:15.864976 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. Jul 12 13:27:15.866254 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:15.867616 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Returning 404 to user: Instance 5236486f-e41e-4a5e-99f3-7cc9a6171a09 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:15.867616 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-ee7f738e-ddcc-4d65-958e-1fb693a218ed tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09" status: 404 len: 111 microversion: 2.1 time: 0.030544 Jul 12 13:27:15.867616 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 551/1106] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:15 2022] GET /compute/v2.1/servers/5236486f-e41e-4a5e-99f3-7cc9a6171a09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:17.017260 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:17.018161 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.compute.api [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117962) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:17.024994 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:17.025439 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:17.026201 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:17.026635 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG oslo_concurrency.lockutils [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:17.041349 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] HTTP exception thrown: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Request method failure captured: Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: DELETE /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 HTTP/1.1 Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXWaYW9JjGVYxJD-nyTrpC126INB3kNn54Jx5c2khaSUpFTgWuZahAGfQPn-NEgmMfKbJIFwYCGvGEA3ubgP-dZUA5UaT0czewkZ54pvae30xfgrhzkaR2M4HNbWBSuvEmnJrnMyRQAvLpx2k0IjtT1TEUvwQvPZBaPfSeG3tm1mBoo Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:27:17.042904 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 648010798a7441fc9af3c682db2bfdc7 Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: > Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.044475 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '47c8a8d8-c71e-4311-844b-2024fab89e92'} Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:17.045399 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.047622 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.049167 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Returning 404 to user: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:17.049167 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-1b8a9bd0-0904-4f3e-94d7-81de18cf0b6a tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "DELETE /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 404 len: 111 microversion: 2.1 time: 0.034035 Jul 12 13:27:17.049167 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 556/1107] 10.222.0.33 () {58 vars in 1238 bytes} [Tue Jul 12 13:27:17 2022] DELETE /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:17.053276 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Calling method '>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:17.053877 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.compute.api [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] [instance: 47c8a8d8-c71e-4311-844b-2024fab89e92] Fetching instance by UUID {{(pid=117963) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:27:17.060624 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:17.061065 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:17.061811 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:27:17.062262 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG oslo_concurrency.lockutils [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Lock "819583d6-75cf-414a-9fda-c907d3b6b6d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:27:17.075910 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] HTTP exception thrown: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Request method failure captured: Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 HTTP/1.1 Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXWaYW9JjGVYxJD-nyTrpC126INB3kNn54Jx5c2khaSUpFTgWuZahAGfQPn-NEgmMfKbJIFwYCGvGEA3ubgP-dZUA5UaT0czewkZ54pvae30xfgrhzkaR2M4HNbWBSuvEmnJrnMyRQAvLpx2k0IjtT1TEUvwQvPZBaPfSeG3tm1mBoo Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:27:17.077405 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ea5e3f6292234dacb166b604e41b40e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: ea5e3f6292234dacb166b604e41b40e3 Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713948144 Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 648010798a7441fc9af3c682db2bfdc7 Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-AttachVolumeTestJSON-1713948144-project Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: > Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.079353 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': '47c8a8d8-c71e-4311-844b-2024fab89e92'} Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:17.080323 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. Jul 12 13:27:17.081588 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:17.082701 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] Returning 404 to user: Instance 47c8a8d8-c71e-4311-844b-2024fab89e92 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:17.082701 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-f4ce225f-c13c-405d-adcc-c1105dcbbcb1 tempest-AttachVolumeTestJSON-1713948144 tempest-AttachVolumeTestJSON-1713948144-project] 10.222.0.33 "GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92" status: 404 len: 111 microversion: 2.1 time: 0.029414 Jul 12 13:27:17.082701 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 552/1108] 10.222.0.33 () {58 vars in 1235 bytes} [Tue Jul 12 13:27:17 2022] GET /compute/v2.1/servers/47c8a8d8-c71e-4311-844b-2024fab89e92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:21.487760 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-cc25c785-3e67-4bed-8718-602d5766a772 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Action: 'create', calling method: .version_select at 0x7fd48d17df70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1418895211"}} {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:21.782318 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-cc25c785-3e67-4bed-8718-602d5766a772 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.419480 Jul 12 13:27:21.783123 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 557/1109] 10.222.0.33 () {60 vars in 1154 bytes} [Tue Jul 12 13:27:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 421 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 13:27:21.793876 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1e10f124-94d1-4979-a1a8-09a8e730c163 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d142550>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:21.848786 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1e10f124-94d1-4979-a1a8-09a8e730c163 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22" status: 200 len: 345 microversion: 2.1 time: 0.058329 Jul 12 13:27:21.849559 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 553/1110] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:27:21 2022] GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:22.868697 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-4b6b8388-2fd3-48d5-9451-57fb5039e33b tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48cf698b0>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:22.924461 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-4b6b8388-2fd3-48d5-9451-57fb5039e33b tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22" status: 200 len: 346 microversion: 2.1 time: 0.062907 Jul 12 13:27:22.925282 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 558/1111] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:27:22 2022] GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:22.936610 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-285b95b1-a93c-47c6-88c4-c1b2b6e64efd tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Action: 'create', calling method: .version_select at 0x7fd48ceda4c0>, body: {"snapshot": {"volume_id": "cee03395-e4ad-4493-a11a-9c0ae7ae6b22", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1505285819"}} {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:27:23.093167 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-285b95b1-a93c-47c6-88c4-c1b2b6e64efd tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.160855 Jul 12 13:27:23.093889 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 554/1112] 10.222.0.33 () {60 vars in 1161 bytes} [Tue Jul 12 13:27:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:23.103757 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-a0a89be5-fc34-4664-8d93-44e9e10721ec tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48cf69c10>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:23.135092 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-a0a89be5-fc34-4664-8d93-44e9e10721ec tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673" status: 200 len: 287 microversion: 2.1 time: 0.035110 Jul 12 13:27:23.135661 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 559/1113] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 12 13:27:23 2022] GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:27:23.146005 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fc6d4218-bcc8-439e-9bb9-87a78fd75de0 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d1243a0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:23.176651 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fc6d4218-bcc8-439e-9bb9-87a78fd75de0 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034574 Jul 12 13:27:23.177216 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 555/1114] 10.222.0.33 () {58 vars in 1139 bytes} [Tue Jul 12 13:27:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:23.187417 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-addd189d-1daa-4b39-95dd-d3cd42d70db8 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48cf69af0>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:23.217020 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-addd189d-1daa-4b39-95dd-d3cd42d70db8 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673" status: 200 len: 287 microversion: 2.1 time: 0.033283 Jul 12 13:27:23.217612 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 560/1115] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 12 13:27:23 2022] GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:24.235146 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-a19af77c-d51c-4de6-b0b9-99ce569aaea1 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d1b5a60>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:24.269301 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-a19af77c-d51c-4de6-b0b9-99ce569aaea1 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673" status: 200 len: 287 microversion: 2.1 time: 0.042872 Jul 12 13:27:24.269867 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 556/1116] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 12 13:27:24 2022] GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:25.282627 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-022dba1e-92fc-43e3-814d-6da02f08ccbd tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d9b44c0>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:25.315571 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-022dba1e-92fc-43e3-814d-6da02f08ccbd tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673" status: 200 len: 287 microversion: 2.1 time: 0.036932 Jul 12 13:27:25.316489 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 561/1117] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 12 13:27:25 2022] GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:26.332913 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5bda1240-e4ce-4c26-bd4f-5659688b0b77 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d110940>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:26.368171 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5bda1240-e4ce-4c26-bd4f-5659688b0b77 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673" status: 200 len: 288 microversion: 2.1 time: 0.039394 Jul 12 13:27:26.369011 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 557/1118] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 12 13:27:26 2022] GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:26.381832 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-9cb155fe-a403-4996-90df-754c36c4a134 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d105310>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:26.445115 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-9cb155fe-a403-4996-90df-754c36c4a134 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673" status: 202 len: 0 microversion: 2.1 time: 0.067161 Jul 12 13:27:26.445847 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 562/1119] 10.222.0.33 () {58 vars in 1253 bytes} [Tue Jul 12 13:27:26 2022] DELETE /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:27:26.456622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-25b8e076-de61-466e-a296-61a9a1c9f437 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d124670>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:26.486833 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-25b8e076-de61-466e-a296-61a9a1c9f437 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673" status: 200 len: 287 microversion: 2.1 time: 0.034743 Jul 12 13:27:26.487416 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 558/1120] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 12 13:27:26 2022] GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:27.498206 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_api:SELECT=22 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.499359 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG dbcounter [-] [117962] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117962) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.506354 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-02db2e75-fcb9-4286-b55f-54ac4abf1224 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d17dc10>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:27.535981 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-02db2e75-fcb9-4286-b55f-54ac4abf1224 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] HTTP exception thrown: Snapshot 98c48dd4-255f-437a-b3a6-2d8b36264673 could not be found. Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-02db2e75-fcb9-4286-b55f-54ac4abf1224 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Request method failure captured: Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673 HTTP/1.1 Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXa5A6uCgO72-rck9EELp_BdwTXHDgtYE2gVlaKzgT7agILfCESU7VWJyqPEZ7m0phsQfUlAA-ziCwWjX2LUjXCJpkQMnV-6MBbJH9P8HSx0rPTrsMUvbXehpLROT2I6AG2aeQJbU81ChNK4i_cu-NSICh6QOIS68D_TV-cQWjYpM_k Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 6b67ab2fb1d14bbca5b2aa58b6bc51bf Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:27:27.538179 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 6b67ab2fb1d14bbca5b2aa58b6bc51bf Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesSnapshotsTestJSON-1847580516-project Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 79e96c9ee96847ef92b49db10b3e2581 Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1847580516-project Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Snapshot 98c48dd4-255f-437a-b3a6-2d8b36264673 could not be found. Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': '98c48dd4-255f-437a-b3a6-2d8b36264673'} Jul 12 13:27:27.539916 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 98c48dd4-255f-437a-b3a6-2d8b36264673 could not be found. (HTTP 404) (Request-ID: req-10178e3f-c548-484b-b978-70aa78fd2194) Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:27.540975 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:27:27.542370 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 98c48dd4-255f-437a-b3a6-2d8b36264673 could not be found. Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 13:27:27.543827 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 98c48dd4-255f-437a-b3a6-2d8b36264673 could not be found. Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 98c48dd4-255f-437a-b3a6-2d8b36264673 could not be found. Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-02db2e75-fcb9-4286-b55f-54ac4abf1224 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Returning 404 to user: Snapshot 98c48dd4-255f-437a-b3a6-2d8b36264673 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:27.545387 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-02db2e75-fcb9-4286-b55f-54ac4abf1224 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673" status: 404 len: 111 microversion: 2.1 time: 0.043313 Jul 12 13:27:27.547261 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 563/1121] 10.222.0.33 () {58 vars in 1250 bytes} [Tue Jul 12 13:27:27 2022] GET /compute/v2.1/os-snapshots/98c48dd4-255f-437a-b3a6-2d8b36264673 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:27.547581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.547581 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG dbcounter [-] [117963] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117963) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.550875 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-e455e5e9-29ca-4b5c-9ebf-9b0238143d70 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d142280>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:27.614855 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-e455e5e9-29ca-4b5c-9ebf-9b0238143d70 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22" status: 202 len: 0 microversion: 2.1 time: 0.069860 Jul 12 13:27:27.615691 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 559/1122] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:27:27 2022] DELETE /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:27:27.624517 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-16e4ed78-48b6-4be5-bfa6-e50253e03b1c tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d105ee0>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:27.673324 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-16e4ed78-48b6-4be5-bfa6-e50253e03b1c tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22" status: 200 len: 345 microversion: 2.1 time: 0.053149 Jul 12 13:27:27.673899 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 564/1123] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:27:27 2022] GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:28.689447 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5d5c9a07-c91c-41cd-b71e-1b11318c0fe7 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d124ee0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:28.718365 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-5d5c9a07-c91c-41cd-b71e-1b11318c0fe7 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] HTTP exception thrown: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5d5c9a07-c91c-41cd-b71e-1b11318c0fe7 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Request method failure captured: Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 HTTP/1.1 Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXa5A6uCgO72-rck9EELp_BdwTXHDgtYE2gVlaKzgT7agILfCESU7VWJyqPEZ7m0phsQfUlAA-ziCwWjX2LUjXCJpkQMnV-6MBbJH9P8HSx0rPTrsMUvbXehpLROT2I6AG2aeQJbU81ChNK4i_cu-NSICh6QOIS68D_TV-cQWjYpM_k Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: 6b67ab2fb1d14bbca5b2aa58b6bc51bf Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:27:28.720379 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 6b67ab2fb1d14bbca5b2aa58b6bc51bf Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesSnapshotsTestJSON-1847580516-project Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 79e96c9ee96847ef92b49db10b3e2581 Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1847580516-project Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': 'cee03395-e4ad-4493-a11a-9c0ae7ae6b22'} Jul 12 13:27:28.722048 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. (HTTP 404) (Request-ID: req-75fb4506-84c2-454f-b808-cbb5bf2042a8) Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:28.723266 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:27:28.724789 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:27:28.726311 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-5d5c9a07-c91c-41cd-b71e-1b11318c0fe7 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Returning 404 to user: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-5d5c9a07-c91c-41cd-b71e-1b11318c0fe7 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22" status: 404 len: 109 microversion: 2.1 time: 0.038899 Jul 12 13:27:28.727750 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 560/1124] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:27:28 2022] GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:28.731980 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0431c118-8bb1-4fa7-946f-057bd5e95e5c tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48da66160>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:28.760175 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.wsgi [None req-0431c118-8bb1-4fa7-946f-057bd5e95e5c tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] HTTP exception thrown: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0431c118-8bb1-4fa7-946f-057bd5e95e5c tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Request method failure captured: Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: request: DELETE /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 HTTP/1.1 Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept: application/json Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Accept-Encoding: identity Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Connection: close Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Length: 0 Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Content-Type: application/json Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Host: 10.222.0.33 Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Openstack-System-Scope: None Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Auth-Token: gAAAAABizXa5A6uCgO72-rck9EELp_BdwTXHDgtYE2gVlaKzgT7agILfCESU7VWJyqPEZ7m0phsQfUlAA-ziCwWjX2LUjXCJpkQMnV-6MBbJH9P8HSx0rPTrsMUvbXehpLROT2I6AG2aeQJbU81ChNK4i_cu-NSICh6QOIS68D_TV-cQWjYpM_k Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Id: None Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Domain-Name: None Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Identity-Status: Confirmed Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Is-Admin-Project: True Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Id: default Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Domain-Name: Default Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Id: 6b67ab2fb1d14bbca5b2aa58b6bc51bf Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Role: reader,member Jul 12 13:27:28.762084 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Roles: reader,member Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Id: 6b67ab2fb1d14bbca5b2aa58b6bc51bf Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User: tempest-VolumesSnapshotsTestJSON-1847580516-project Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Id: default Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Domain-Name: Default Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Id: 79e96c9ee96847ef92b49db10b3e2581 Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1847580516-project Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: method: Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: exception: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: action_args: {'id': 'cee03395-e4ad-4493-a11a-9c0ae7ae6b22'} Jul 12 13:27:28.763873 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. (HTTP 404) (Request-ID: req-3f81f4e0-06ed-40a9-a55d-b7bb2851261e) Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:28.765026 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:27:28.766912 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 13:27:28.768293 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-0431c118-8bb1-4fa7-946f-057bd5e95e5c tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Returning 404 to user: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. {{(pid=117962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:28.769734 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-0431c118-8bb1-4fa7-946f-057bd5e95e5c tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22" status: 404 len: 109 microversion: 2.1 time: 0.036074 Jul 12 13:27:28.770741 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 565/1125] 10.222.0.33 () {58 vars in 1247 bytes} [Tue Jul 12 13:27:28 2022] DELETE /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:28.772622 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fdcbbb75-ed3f-4ea2-b46c-d30adf7a1c51 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Calling method '.version_select at 0x7fd48d142160>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:28.806838 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.wsgi [None req-fdcbbb75-ed3f-4ea2-b46c-d30adf7a1c51 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] HTTP exception thrown: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fdcbbb75-ed3f-4ea2-b46c-d30adf7a1c51 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Request method failure captured: Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: request: GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 HTTP/1.1 Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept: application/json Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Accept-Encoding: identity Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Connection: close Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Length: 0 Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Content-Type: application/json Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Host: 10.222.0.33 Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Openstack-System-Scope: None Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: User-Agent: python-urllib3/1.26.9 Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Auth-Token: gAAAAABizXa5A6uCgO72-rck9EELp_BdwTXHDgtYE2gVlaKzgT7agILfCESU7VWJyqPEZ7m0phsQfUlAA-ziCwWjX2LUjXCJpkQMnV-6MBbJH9P8HSx0rPTrsMUvbXehpLROT2I6AG2aeQJbU81ChNK4i_cu-NSICh6QOIS68D_TV-cQWjYpM_k Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Id: None Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Domain-Name: None Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Identity-Status: Confirmed Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Is-Admin-Project: True Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Id: default Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Domain-Name: Default Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Id: 6b67ab2fb1d14bbca5b2aa58b6bc51bf Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Role: reader,member Jul 12 13:27:28.808809 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Roles: reader,member Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b67ab2fb1d14bbca5b2aa58b6bc51bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Id: 6b67ab2fb1d14bbca5b2aa58b6bc51bf Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1847580516 Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User: tempest-VolumesSnapshotsTestJSON-1847580516-project Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Id: default Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Domain-Name: Default Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Id: 79e96c9ee96847ef92b49db10b3e2581 Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1847580516-project Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: method: Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: exception: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: action_args: {'id': 'cee03395-e4ad-4493-a11a-9c0ae7ae6b22'} Jul 12 13:27:28.810372 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. (HTTP 404) (Request-ID: req-0a731b16-2514-4883-943e-33b27fb66234) Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:28.811434 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:27:28.813138 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:27:28.814638 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: ERROR nova.api.openstack.wsgi Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-fdcbbb75-ed3f-4ea2-b46c-d30adf7a1c51 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] Returning 404 to user: Volume cee03395-e4ad-4493-a11a-9c0ae7ae6b22 could not be found. {{(pid=117963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-fdcbbb75-ed3f-4ea2-b46c-d30adf7a1c51 tempest-VolumesSnapshotsTestJSON-1847580516 tempest-VolumesSnapshotsTestJSON-1847580516-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22" status: 404 len: 109 microversion: 2.1 time: 0.041381 Jul 12 13:27:28.816102 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 561/1126] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:27:28 2022] GET /compute/v2.1/os-volumes/cee03395-e4ad-4493-a11a-9c0ae7ae6b22 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:27:31.613109 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-ee02cb89-e14c-4560-b55c-21fe0e5342c8 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48d105940>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:31.664528 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-ee02cb89-e14c-4560-b55c-21fe0e5342c8 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4d68aa9b-06ec-4218-b361-dd32500ca28b" status: 200 len: 350 microversion: 2.1 time: 0.056264 Jul 12 13:27:31.665095 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 566/1127] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:27:31 2022] GET /compute/v2.1/os-volumes/4d68aa9b-06ec-4218-b361-dd32500ca28b => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:33.051350 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c58cad46-760d-45ef-90d5-f1d558c1366e tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48d1240d0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:33.103930 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c58cad46-760d-45ef-90d5-f1d558c1366e tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0947d624-16ea-4338-bcdf-b60e886e71ac" status: 200 len: 351 microversion: 2.1 time: 0.057265 Jul 12 13:27:33.104504 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 562/1128] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:27:33 2022] GET /compute/v2.1/os-volumes/0947d624-16ea-4338-bcdf-b60e886e71ac => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:34.440646 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-fe349d24-908b-4cc8-9ab9-da1847468cd0 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48cf69820>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:34.492523 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-fe349d24-908b-4cc8-9ab9-da1847468cd0 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/2e592420-1493-4613-9d97-945ba21d2eba" status: 200 len: 351 microversion: 2.1 time: 0.056646 Jul 12 13:27:34.493091 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 567/1129] 10.222.0.33 () {58 vars in 1244 bytes} [Tue Jul 12 13:27:34 2022] GET /compute/v2.1/os-volumes/2e592420-1493-4613-9d97-945ba21d2eba => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:34.509012 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-1896bbaa-facf-4b3c-969c-74377aa65549 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48d0ca4c0>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:34.596107 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-1896bbaa-facf-4b3c-969c-74377aa65549 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093385 Jul 12 13:27:34.596682 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 563/1130] 10.222.0.33 () {58 vars in 1133 bytes} [Tue Jul 12 13:27:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:34.613748 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-c04025b3-b142-4b2d-88c0-5e4440c3846f tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48cfc7af0>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:34.698889 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-c04025b3-b142-4b2d-88c0-5e4440c3846f tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090917 Jul 12 13:27:34.699495 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 568/1131] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Jul 12 13:27:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:34.711174 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-30109e77-9559-46c3-9648-ebc77b6e29b5 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48d268280>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:34.794486 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-30109e77-9559-46c3-9648-ebc77b6e29b5 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087035 Jul 12 13:27:34.795115 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 564/1132] 10.222.0.33 () {58 vars in 1133 bytes} [Tue Jul 12 13:27:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:34.806657 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-adffaa92-9994-43bf-9221-5c7890e0427f tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48d181f70>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:34.887721 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-adffaa92-9994-43bf-9221-5c7890e0427f tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084727 Jul 12 13:27:34.888298 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 569/1133] 10.222.0.33 () {58 vars in 1166 bytes} [Tue Jul 12 13:27:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:34.902791 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-b8a71ed8-693a-4ef6-8de0-92dc16d33c48 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48d16c700>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:34.997830 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-b8a71ed8-693a-4ef6-8de0-92dc16d33c48 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.101294 Jul 12 13:27:34.998526 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 565/1134] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Jul 12 13:27:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:35.010582 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-7c13672b-3f16-412f-8df1-6498a6eea0d0 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48d181790>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:35.091366 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-7c13672b-3f16-412f-8df1-6498a6eea0d0 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084382 Jul 12 13:27:35.091940 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 570/1135] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 12 13:27:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:35.103385 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: DEBUG nova.api.openstack.wsgi [None req-c44ef348-a6ee-476b-ad5c-6c96387b10c4 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48d208820>' {{(pid=117963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:35.185565 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO nova.api.openstack.requestlog [None req-c44ef348-a6ee-476b-ad5c-6c96387b10c4 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086017 Jul 12 13:27:35.186111 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: [pid: 117963|app: 0|req: 566/1136] 10.222.0.33 () {58 vars in 1187 bytes} [Tue Jul 12 13:27:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:27:35.197890 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: DEBUG nova.api.openstack.wsgi [None req-b5acb306-f34d-41d5-af08-bfecfb89be32 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] Calling method '.version_select at 0x7fd48dafea60>' {{(pid=117962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:27:35.278702 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO nova.api.openstack.requestlog [None req-b5acb306-f34d-41d5-af08-bfecfb89be32 tempest-VolumesTestJSON-133298519 tempest-VolumesTestJSON-133298519-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084226 Jul 12 13:27:35.279542 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: [pid: 117962|app: 0|req: 571/1137] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Jul 12 13:27:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:37.319076 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:28:37.320167 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Tue Jul 12 13:28:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:28:39.611769 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:28:39.612264 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Tue Jul 12 13:28:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:30:16.666522 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:30:16.667305 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Tue Jul 12 13:30:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:31:17.448201 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:31:17.449942 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Tue Jul 12 13:31:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:31:57.332223 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:31:57.333011 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Tue Jul 12 13:31:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:31:59.620768 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:31:59.621326 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Tue Jul 12 13:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:32:12.012554 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:32:12.013635 dv-cinder-797608-55-iscsi devstack@n-api.service[117962]: Tue Jul 12 13:32:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:32:12.360880 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:32:12.360880 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Tue Jul 12 13:32:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:33:36.677321 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:33:36.677321 dv-cinder-797608-55-iscsi devstack@n-api.service[117963]: Tue Jul 12 13:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!